-- Logs begin at Thu 2022-06-23 18:45:28 UTC, end at Thu 2022-06-23 20:28:03 UTC. -- Jun 23 19:58:11.181744 dv-cinder-847274-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 19:58:11.190699 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 19:58:11 2022] *** Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: nodename: dv-cinder-847274-2-iscsi Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: machine: x86_64 Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: clock source: unix Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: pcre jit disabled Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: detected number of CPU cores: 4 Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: current working directory: / Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: detected binary path: /usr/bin/uwsgi-core Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: your processes number limit is 47680 Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: your memory page size is 4096 bytes Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: detected max file descriptor number: 2048 Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: lock engine: pthread robust mutexes Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: thunder lock: enabled Jun 23 19:58:11.193038 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 19:58:11.194152 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 19:58:11.237336 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: Python main interpreter initialized at 0x56039dddb9c0 Jun 23 19:58:11.237336 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: python threads support enabled Jun 23 19:58:11.237336 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: your server socket listen backlog is limited to 100 connections Jun 23 19:58:11.237336 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: your mercy for graceful operations on workers is 90 seconds Jun 23 19:58:11.237702 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 19:58:11.237780 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: *** Operational MODE: preforking *** Jun 23 19:58:11.238023 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: *** uWSGI is running in multiple interpreter mode *** Jun 23 19:58:11.238023 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: spawned uWSGI master process (pid: 103810) Jun 23 19:58:11.238216 dv-cinder-847274-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 19:58:11.239653 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: spawned uWSGI worker 1 (pid: 103811, cores: 1) Jun 23 19:58:11.239653 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: spawned uWSGI worker 2 (pid: 103812, cores: 1) Jun 23 19:58:11.239653 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 19:58:11.896199 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 19:58:11.896890 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 19:58:13.044123 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 19:58:13.044123 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: from cryptography.utils import int_from_bytes Jun 23 19:58:13.044891 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 19:58:13.044891 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: from cryptography.utils import int_from_bytes Jun 23 19:58:13.045295 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 19:58:13.045295 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: from cryptography.utils import int_from_bytes Jun 23 19:58:13.045465 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 19:58:13.045465 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: from cryptography.utils import int_from_bytes Jun 23 19:58:15.606463 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 19:58:15.607023 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 19:58:15.607391 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 19:58:15.607752 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 19:58:15.608006 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 19:58:15.608416 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.608743 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.609065 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.609388 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.609707 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.610015 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.610334 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.610650 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.610976 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.611233 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.611546 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.611865 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847274-2-iscsi {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.612185 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.612519 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.612834 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.613149 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.613450 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.613769 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.614061 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 19:58:15.614446 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.614530 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 19:58:15.614633 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.614835 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 19:58:15.615893 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.616051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 19:58:15.616193 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.616340 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 19:58:15.616462 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.616608 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.616732 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.616879 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.616995 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.617125 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.617249 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.617374 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.617498 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.617620 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.617750 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.617869 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.617992 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.618123 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.618256 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.618421 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.618550 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847274-2-iscsi {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.618673 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.618797 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.618921 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.619064 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.619189 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.619312 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.619454 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847274-2-iscsi {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.619587 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.619714 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.619837 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.619948 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.620076 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.620200 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.620399 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.620543 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.620719 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.620848 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.621024 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.621166 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.621334 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.621462 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.621650 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.621838 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.621978 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.622151 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.622286 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.622458 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.622615 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.622797 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.622951 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.623139 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.623287 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.623457 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.623568 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.623769 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.623856 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.624087 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.624173 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.624357 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.624458 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.624669 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.624764 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.624986 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.625072 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.625303 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.625435 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847274-2-iscsi {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.625622 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.625736 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.625871 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.626052 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.626138 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.626367 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.626452 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.626725 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.626831 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.627031 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.627119 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.627337 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.627423 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.627644 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.627741 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.627950 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.628036 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.628255 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.628374 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.628590 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.628692 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.628897 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.629004 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.629247 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.629337 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.629565 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.629656 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.629852 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.629954 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.630170 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.630257 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.630485 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.630579 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.630807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.630892 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.631118 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.631242 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.631427 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.631519 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.631679 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.631771 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.631994 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.632112 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.632338 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.632515 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.632667 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.632807 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.632977 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.633146 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.633317 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.633459 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.633597 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.633735 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.633949 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.634110 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.634250 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.634399 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.634537 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.634673 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.634822 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.634967 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.635113 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.635259 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.635404 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.635542 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.635700 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.635839 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.635976 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.636112 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.636249 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.636410 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.636565 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.636704 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.636841 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.636978 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.637125 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.637264 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.637481 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.637632 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.637778 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.637916 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.638068 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.638722 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.638983 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.639128 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.639266 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.639430 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.639580 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.639753 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.639901 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.640046 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.640194 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.640366 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.640535 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.640688 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.640861 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.641014 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.641189 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.641343 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.641505 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.641658 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.641841 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.641986 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.642155 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.642313 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.642475 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.642615 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.642807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.642960 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.643120 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.643275 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.643414 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.643561 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.643706 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.643850 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.644071 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.644225 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.644419 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.644561 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.644699 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.644842 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.644987 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.645124 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.645269 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.645424 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.645564 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.645701 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.645838 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.645986 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.646143 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.646282 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.646427 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.646563 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.646708 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.646852 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.646999 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.647137 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.647308 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.647453 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.647598 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.647744 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.647890 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.648042 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.648180 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.648341 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.648487 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.648637 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.648783 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.648922 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.649069 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.649207 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.649344 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.649490 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.649659 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.649804 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.649962 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.650100 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.650271 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.650423 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.650563 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.650700 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.650866 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.651011 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.651181 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.651335 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.651517 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.651670 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.651845 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.652008 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.652148 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.652318 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.652498 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.652653 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.652799 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.652944 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.653120 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.653275 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.653414 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.653551 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.653724 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.654436 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.654660 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.654804 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.654942 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.655088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.655226 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.655363 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.655509 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.655647 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.655784 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.655922 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.656059 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.656197 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.656387 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.656534 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.656672 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.656809 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.656980 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.657138 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.657278 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.657415 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.657594 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.657748 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.657921 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.658076 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.658224 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.658453 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.658599 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.658828 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.658971 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.659152 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 19:58:15.659299 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.659461 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.659611 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.659803 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.659948 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.660142 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.660288 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.660606 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.660757 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.660905 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.661044 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.661194 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.661332 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.661471 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.661609 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.661746 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.661889 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.662041 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.662188 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.662336 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.662486 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.662655 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.662810 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.662950 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.663095 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.663270 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.663427 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.663567 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.663714 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.663861 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.664000 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.664171 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.664350 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.664518 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.664691 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.664900 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.665043 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.665190 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.665329 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.665467 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.665618 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.665757 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.665895 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.666039 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.666187 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.666344 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.666484 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.666623 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.666767 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.666906 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.667049 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.667201 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.667391 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.667538 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.667709 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.667858 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.668038 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.668195 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.668399 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.668555 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.668696 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.668833 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.668977 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.669124 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.669288 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.669432 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.669641 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.669788 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.669967 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.670112 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.670257 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.670415 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.670563 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.670702 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.670850 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.670997 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.671142 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.671281 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.671420 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.671557 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.671730 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.671886 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.672025 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.672164 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.672344 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.672490 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.672645 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.672785 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.672925 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.673063 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.673228 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.673381 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.673551 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.673696 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.673841 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.673982 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.674130 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.674276 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.674441 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.674587 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.674748 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.674910 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.675126 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.675278 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.675418 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.675556 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.675701 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.675860 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.676039 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.676203 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.676379 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.676534 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.676704 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.676850 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.677001 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.677148 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.677334 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.677481 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.677644 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.677789 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.677988 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.678136 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.678285 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.678431 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.678598 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.678742 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.678898 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.679037 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.679192 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.679382 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.679529 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.679724 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.679883 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.680099 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.680246 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.680454 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.680601 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.680749 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.680895 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.681056 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.681199 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.681362 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.681507 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.681653 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.681793 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.681953 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.682112 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.682269 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.682410 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.682556 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.682701 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.682840 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.682978 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.683144 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.683290 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.683442 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.683589 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.683728 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.683874 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.684084 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.684255 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.684462 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.684611 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.684757 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.684896 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.685168 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.685332 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.685480 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.685619 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.685756 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.685894 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.686038 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.686185 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.686334 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.686479 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.686626 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.686775 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.686915 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.687061 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.687229 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.687375 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.687513 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.687651 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.687829 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.688054 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.688196 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.688379 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.688524 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.688663 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.688817 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.688964 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.689102 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.689247 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.689386 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.689523 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.689671 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.689810 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.689975 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.690124 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.690262 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.690427 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.690581 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.690815 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.690967 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.691167 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.691311 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.691480 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.691634 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.691825 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.691970 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.692163 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.692364 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.692522 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.692663 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.692851 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.693005 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.693171 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.693329 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.693478 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.693617 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.693794 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.693947 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.694110 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.694272 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.694432 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.694573 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.694718 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.694865 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.695039 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.695187 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.695421 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.695814 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.695954 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.696129 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.696272 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.696491 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.696638 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.696920 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.697070 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.697248 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.697394 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.697552 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.697692 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.697917 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.698062 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.698230 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.698384 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.698531 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.698679 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.698850 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.699014 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.699160 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.699299 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.699545 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.699713 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.699854 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.699992 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.700137 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.700277 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.700470 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.700611 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.701373 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.701535 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.701698 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.701857 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.702028 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.702173 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.702350 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.702496 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.702678 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.702832 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.702999 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.703164 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.703328 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.703486 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.703643 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.703795 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.703986 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.704140 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.704279 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.704476 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.704627 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.704775 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.704950 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.705096 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.705318 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.705545 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.705707 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.705864 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.706038 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.706185 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.706329 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.706474 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.706653 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.706807 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.706952 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.707129 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.707304 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.707458 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.707613 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.707758 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.707912 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.708056 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.708200 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.708411 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.708575 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.708722 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.708871 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.709016 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.709165 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.709325 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.709469 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.709614 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.709757 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.709911 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.710061 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.710223 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.710369 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.710512 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.710658 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.710809 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.710954 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.711105 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.711250 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.711394 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.711537 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.711693 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.711843 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.711996 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.712141 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.712315 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.712473 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.712628 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.712783 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.712928 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.713083 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.713228 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.713378 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.713522 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.713685 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.713832 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.714015 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.714168 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.714384 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.714535 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.714692 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.714838 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.714983 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.715127 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.715282 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.715427 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.715663 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.715928 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.716081 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.716234 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.716977 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.717140 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.717325 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.717477 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.717652 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.717805 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.717980 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.718142 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.718288 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.718433 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.718629 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.718775 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.718943 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.719170 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.719318 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.719471 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.719629 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.719783 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.719935 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.720089 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.720248 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.720436 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.720597 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.720742 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.720887 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.721031 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.721188 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.721335 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.721479 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.721623 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.721767 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.721909 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.722064 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.722247 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.722401 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.722556 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.722699 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.722852 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.723006 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.723168 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.723330 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.723526 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.723679 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.723832 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.723985 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.724130 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.724275 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.724461 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.724641 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.724804 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.724957 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.725112 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.725284 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.725452 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.725640 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.725859 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.726024 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.726171 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.726316 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.726469 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.726614 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.726780 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.726936 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.727082 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.727226 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.727369 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.727514 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.727666 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.727812 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.727957 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.728101 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.728244 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.728425 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.728598 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.728744 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.728904 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.729057 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.729202 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.729346 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.729513 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.729661 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.729805 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.729949 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.730102 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.730258 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.730416 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.730573 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.730718 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.730861 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.731004 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.731157 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.731303 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.731480 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.731638 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.731784 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.731950 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.732108 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.732255 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.732456 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.732613 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.732759 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.732913 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.733067 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.733067 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.733342 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.733486 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.733636 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.733782 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.733934 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.734087 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.734239 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.734394 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.734596 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.734760 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.734907 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.735050 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.735205 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.735350 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.735494 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.735646 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.735798 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.736025 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.736183 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.736349 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.736512 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.736670 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.736815 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.736960 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.737104 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.737247 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.737391 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.737543 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.737688 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.737832 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.737984 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.738129 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.738282 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.738445 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.738591 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.738735 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.738878 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.739023 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.739180 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.739326 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.739481 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.739627 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.739771 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.739915 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.740067 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.740221 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.740432 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.740524 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.740595 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.740698 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.740783 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.740853 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.740918 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.741065 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.741180 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.741457 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.741634 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.741767 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.741943 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.742083 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.742255 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.742435 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.742562 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.742724 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.742871 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.743015 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.743161 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.743315 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.743468 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.743613 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.743758 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.743920 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.744067 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.744221 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.744423 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.744572 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.744716 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.744879 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.745034 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.745180 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.745333 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.745477 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.745629 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.745781 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.745949 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.746177 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.746337 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.746483 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.746628 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.746771 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.746923 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.747069 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.747225 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.747371 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.748029 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.748184 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.748414 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.748577 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.748723 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.748867 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.749011 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.749165 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.749320 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.749474 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.749619 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.749763 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.749913 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.750072 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.750218 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.750362 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.750545 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.750696 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.750970 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.751284 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.751604 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.751923 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.752243 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.752574 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.752886 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.753198 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.753506 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.753814 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.753972 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.754131 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.754283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.754441 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.754588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.754733 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.754932 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.755086 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.755310 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.755621 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.755926 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.756077 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.756355 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.756523 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.756681 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.756829 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.756974 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.757118 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.757262 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.757450 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.757611 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.757757 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.757901 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.758045 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.758189 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.758333 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.758496 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.758642 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.758787 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.758932 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.759112 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.759329 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.759483 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.759627 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.759771 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.759945 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.760098 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.760250 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.760406 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.760584 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.760698 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.760914 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.761011 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.761214 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.761315 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.761528 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.761620 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.761833 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.761955 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.762245 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.762336 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.762558 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.762646 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.762874 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.763045 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.763245 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.763894 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.764070 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.764223 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.764409 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.764568 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.764714 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.764856 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.765011 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.765168 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.765314 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.765479 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.765632 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.765777 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.765945 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.766095 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.766241 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.766479 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.766632 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.766777 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.766921 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.767065 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.767239 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.767393 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.767538 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.767683 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.767827 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.767979 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.768132 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.768278 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.768481 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.768637 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.768790 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.768937 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.769090 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.769259 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.769406 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.769559 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.769704 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.769848 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.770000 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.770151 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.770328 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.770474 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.770618 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.770795 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.770955 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.771111 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.771256 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.771400 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.771544 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.771696 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.771853 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.772000 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.772144 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.772314 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.772479 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.772634 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.772867 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.773021 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.773176 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.773320 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.773491 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.773653 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.773799 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.773952 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.774115 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.774308 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.774540 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.774696 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.774841 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.775021 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.775174 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.775353 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.775516 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.775665 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.775822 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.775969 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.776147 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.776413 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.776646 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.776798 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.776956 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.777103 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.777255 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.777255 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.777545 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.777698 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.777854 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.777999 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.778144 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.778301 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.778454 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.778601 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.778774 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.778936 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.779083 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.779228 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.779383 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.779538 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.779686 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.779831 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.779976 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.780121 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.780274 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.780468 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.780617 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.780763 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.780917 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.781063 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.781209 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.781377 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.781524 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.781669 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.781814 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.781960 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.782105 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.782263 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.782423 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.782570 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.782715 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.782861 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.783015 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.783164 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.783319 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.783464 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.783615 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.783761 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.783914 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.784066 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.784221 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.784395 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.784543 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.784697 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.784919 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.785080 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.785237 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.785383 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.785528 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.785672 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.785826 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.785973 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.786117 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.786262 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.786415 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.786569 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.786796 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.786948 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.787094 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.787258 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.787406 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.787563 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.787709 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.787854 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.787999 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.788151 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.788331 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.788502 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.788651 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.788796 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.788947 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.789093 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.789249 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.789408 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.789554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.789699 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.789843 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.789987 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.790141 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.790286 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.790438 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.790590 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.790737 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.790880 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.791034 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.791190 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.791335 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.791492 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.791638 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.791783 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.791937 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.792082 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.792234 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.792409 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.792557 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.792701 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.792866 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.793013 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.793168 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.793313 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.793458 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.793611 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.793766 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.793913 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.794057 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.794202 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.794346 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.794532 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.794680 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.794825 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.794988 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.795138 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.795283 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.795436 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.795584 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.795735 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.795880 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.796025 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.796169 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.796356 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.796509 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.796656 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.796818 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.797040 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.797204 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.797352 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.797504 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.797649 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.797795 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.797939 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.798093 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.798240 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.798384 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.798529 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.798672 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.798825 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.798989 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.799142 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.799288 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.799433 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.799584 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.799730 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.799883 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.800030 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.800174 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.800338 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.800490 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.800648 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.800806 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.800958 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.801104 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.801258 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.801404 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.801558 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.801739 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.801901 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.802047 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.802192 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.802336 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.802491 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.802650 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.802817 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.802983 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.803131 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.803340 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.803500 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.803683 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.803835 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.803981 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.804124 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.804278 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.804493 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.804650 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.804797 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.804941 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.805108 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.805256 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.805409 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.805555 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.805706 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.805852 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.806006 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.806153 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.806297 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.806442 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.806606 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.806752 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.806907 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.807070 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.807285 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.807443 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.807597 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.807741 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.808002 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.808164 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.808338 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.808490 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.808652 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.808809 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.808957 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.809109 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.809281 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.809434 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.809602 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.809796 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.809958 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.810681 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.810851 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.811025 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.811187 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.811354 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.811501 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.811645 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.811788 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.811963 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.812125 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.812273 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.812474 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.812632 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.812780 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.812925 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.813078 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.813243 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.813391 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.813543 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.813689 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.813842 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.814062 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.814210 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.814356 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.814505 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.814649 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.814802 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.814957 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.815114 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.815266 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.815414 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.815559 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.815719 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.815869 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.816021 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.816209 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.816403 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.816583 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.816745 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.816898 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.817044 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.817206 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.817435 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.817598 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.817746 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.817891 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.818043 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.818189 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.818341 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.818496 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.818694 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.818847 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.818999 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.819156 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.819312 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.819471 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.819617 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.819763 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.819907 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.820052 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.820204 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.820400 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.820806 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.820952 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.821096 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.821241 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.821406 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.821552 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.821703 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.821850 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.822002 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.822171 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.822327 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.822474 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.822624 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.822770 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.822916 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.823060 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.823214 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.823370 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.823516 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.823667 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.823812 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.823957 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.824111 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.824263 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.824496 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.824651 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.824797 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.824952 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.825107 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.825260 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.825417 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.825594 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.826328 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.826497 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.826645 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.826796 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.826942 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.827181 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.827336 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.827574 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.827727 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.827873 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.828052 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.828200 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.828386 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.828553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.828708 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.828878 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.829102 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.829264 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.829419 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.829566 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.829718 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.829864 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.830009 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.830169 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.830323 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.830469 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.830621 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.830774 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.830943 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.831096 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.831252 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.831398 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.831609 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.831761 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.831917 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.832104 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.832270 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.832510 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.832664 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.832848 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.833002 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.833180 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.833336 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.833482 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.833626 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.833771 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.833915 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.834069 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.834228 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.834373 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.834518 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.834685 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.834845 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.835004 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.835150 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.835303 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.835450 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.835609 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.835768 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.835914 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.836070 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.836227 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.836435 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.836584 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.836742 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.836896 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.837049 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.837195 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.837338 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.837482 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.837726 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.837879 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.838025 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.838177 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.838341 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.838489 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.838643 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.838790 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.838941 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.839088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.839233 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.839390 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.839536 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.839683 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.839836 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.839982 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.840136 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.840290 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.840466 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.840611 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.840757 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.840901 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.841044 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.841203 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.841426 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.841597 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.841786 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.841937 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.842121 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.842297 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.842444 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.842596 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.842750 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.842895 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.843096 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.843248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.843400 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.843546 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.843690 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.843835 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.844057 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.844217 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.844409 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.844560 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.844717 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.844865 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.845020 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.845167 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.845326 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.845474 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.845619 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.845776 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.845924 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.846077 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.846237 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.846385 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.846531 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.846689 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.846836 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.846982 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.847127 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.847279 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.847425 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.847579 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.847743 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.847966 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.848136 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.848283 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.848471 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.848620 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.848772 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.848919 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.848919 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.849196 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.849353 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.849500 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.849652 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.849799 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.849944 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.850103 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.850257 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.850411 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.850557 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.850703 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.850877 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.851038 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.851186 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.851339 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.851484 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.851648 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.851799 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.851954 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.852119 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.852266 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.852403 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.852508 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.852638 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.852739 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.852945 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.853060 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.853250 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.853384 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.853560 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.853728 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.853912 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.854062 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.854210 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.854349 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.854533 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.854678 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.854928 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.855068 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.855244 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.855377 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.855584 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.855748 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.855895 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.856082 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.856225 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.856565 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.856716 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.856916 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.857053 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.857252 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.857403 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.857581 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.857772 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.857910 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.858134 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.858291 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.858437 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.858584 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.858742 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.858881 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.859059 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.859197 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.859370 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.859520 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.859678 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.859816 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.859993 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.860131 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.860352 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.860524 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.860674 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.860818 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.860963 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.861107 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.861266 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.861413 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.861558 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.861704 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.861850 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.861995 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.862159 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.862313 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.862469 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.862615 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.862761 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.862906 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.863060 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.863206 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.863359 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.863506 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.863651 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.863797 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.863982 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.864142 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.864289 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.864473 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.864629 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.864784 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.864931 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.865076 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.865229 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.865375 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.865519 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.865678 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.865826 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.865981 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.866126 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.866271 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.866423 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.866583 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.866729 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.866874 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.867025 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.867171 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.867325 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.867471 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.867627 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.867780 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.867943 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.868089 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.868357 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.868515 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.868672 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.868818 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.868971 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.869117 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.869270 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.869423 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.869570 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.869721 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.869866 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.870038 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.870318 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.870472 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.870617 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.870762 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 19:58:15.870908 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.871066 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.871261 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.871574 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.871905 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.872229 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.873091 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.873417 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.873735 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.874070 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.874390 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.874707 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.875030 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.875350 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.875700 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.875994 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.876339 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.876676 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.877009 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.877330 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.877664 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.877998 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.878352 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.878674 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.879023 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.879357 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.879678 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.879999 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.880330 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 19:58:15.880584 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 19:58:16.027486 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO dbcounter [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Registered counter for database nova_api Jun 23 19:58:16.034586 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO dbcounter [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Registered counter for database nova_api Jun 23 19:58:16.049066 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_db.sqlalchemy.engines [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:58:16.055503 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writer thread running {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:58:16.056195 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG oslo_db.sqlalchemy.engines [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:58:16.062740 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writer thread running {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:58:16.115276 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.context [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c482a6c1-3f12-412c-9ae5-5047910964a9(cell1) {{(pid=103811) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 19:58:16.119148 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 19:58:16.120766 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 19:58:16.121077 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.context [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c482a6c1-3f12-412c-9ae5-5047910964a9(cell1) {{(pid=103812) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 19:58:16.121563 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 19:58:16.123556 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 19:58:16.125035 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG oslo_concurrency.lockutils [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 19:58:16.125550 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO dbcounter [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Registered counter for database nova_cell0 Jun 23 19:58:16.126640 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG oslo_concurrency.lockutils [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 19:58:16.127441 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG oslo_concurrency.lockutils [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 19:58:16.129433 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG oslo_concurrency.lockutils [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 19:58:16.129693 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO dbcounter [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Registered counter for database nova_cell1 Jun 23 19:58:16.131404 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO dbcounter [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Registered counter for database nova_cell0 Jun 23 19:58:16.135450 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO dbcounter [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Registered counter for database nova_cell1 Jun 23 19:58:16.137358 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_db.sqlalchemy.engines [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:58:16.139883 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_db.sqlalchemy.engines [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:58:16.143381 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG oslo_db.sqlalchemy.engines [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:58:16.145345 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG oslo_db.sqlalchemy.engines [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:58:16.145804 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writer thread running {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:58:16.147979 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writer thread running {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:58:16.152079 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writer thread running {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:58:16.153585 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writer thread running {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:58:16.298052 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO dbcounter [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Registered counter for database nova_cell0 Jun 23 19:58:16.302989 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO dbcounter [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Registered counter for database nova_cell0 Jun 23 19:58:16.306797 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_db.sqlalchemy.engines [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:58:16.311174 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writer thread running {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:58:16.311437 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG oslo_db.sqlalchemy.engines [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 19:58:16.315786 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writer thread running {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 19:58:16.749074 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: WARNING keystonemiddleware.auth_token [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 19:58:16.756230 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: WARNING keystonemiddleware.auth_token [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 19:58:16.862214 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: WARNING keystonemiddleware.auth_token [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 19:58:16.869490 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: WARNING keystonemiddleware.auth_token [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 19:58:17.090642 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: WARNING keystonemiddleware.auth_token [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 19:58:17.096968 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: WARNING keystonemiddleware.auth_token [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 19:58:17.102391 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56039dddb9c0 pid: 103811 (default app) Jun 23 19:58:17.104688 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:58:17.105899 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001935 Jun 23 19:58:17.106321 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Thu Jun 23 19:58:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:58:17.207713 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: WARNING keystonemiddleware.auth_token [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 19:58:17.213784 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: WARNING keystonemiddleware.auth_token [None req-464ee22a-9881-46a2-b693-b33157d629cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 19:58:17.219613 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56039dddb9c0 pid: 103812 (default app) Jun 23 19:59:36.192131 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:36.193202 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 23 19:59:36.193605 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:59:36.210889 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_api:SELECT=3 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:36.211604 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_cell0:SELECT=3 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:36.212648 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_cell1:SELECT=3 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:36.213371 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:36.675334 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-cde7b5d4-24ef-4781-8525-24508dee90a1 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:36.706548 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-cde7b5d4-24ef-4781-8525-24508dee90a1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.505212 Jun 23 19:59:36.707349 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jun 23 19:59:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 19:59:38.845663 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:38.846677 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-a72d836d-f01a-4709-8bc6-b54cef8f65cf None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 23 19:59:38.847069 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:59:38.919223 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-ebee09d2-31ce-41ea-a4dc-c3073b4eade2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:38.938234 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:59:38.938234 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: warnings.warn(msg) Jun 23 19:59:39.069526 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-ebee09d2-31ce-41ea-a4dc-c3073b4eade2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.216153 Jun 23 19:59:39.070091 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 19:59:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 19:59:39.285619 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-69c1f66f-9065-4031-8375-7f117fdf89a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:39.288032 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:59:39.288032 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: warnings.warn(msg) Jun 23 19:59:39.290744 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_api:SELECT=3 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:39.291615 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_cell1:SELECT=3 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:39.293022 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_cell0:SELECT=3 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:39.293763 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 19:59:39.454423 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-69c1f66f-9065-4031-8375-7f117fdf89a5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.375709 Jun 23 19:59:39.455037 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 23 19:59:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 19:59:41.579121 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-ebee09d2-31ce-41ea-a4dc-c3073b4eade2 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:41.580808 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-ebee09d2-31ce-41ea-a4dc-c3073b4eade2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001848 Jun 23 19:59:41.581479 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:59:41.695715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-759457ff-7738-4ed2-8686-1c8bc820d0b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:41.714042 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:59:41.714042 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: warnings.warn(msg) Jun 23 19:59:41.820037 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-759457ff-7738-4ed2-8686-1c8bc820d0b2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.229789 Jun 23 19:59:41.822599 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 19:59:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 19:59:41.833249 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-a34ec08b-307a-4fef-b182-b4f0c8b8f0ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:41.834729 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 19:59:41.834729 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: warnings.warn(msg) Jun 23 19:59:41.988732 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-a34ec08b-307a-4fef-b182-b4f0c8b8f0ba admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.158973 Jun 23 19:59:41.989362 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 23 19:59:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 19:59:44.066681 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-759457ff-7738-4ed2-8686-1c8bc820d0b2 admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:44.067704 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-759457ff-7738-4ed2-8686-1c8bc820d0b2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 23 19:59:44.068104 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:59:44.129376 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-fd37f744-6a93-4146-82b1-a71250a56478 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:44.209236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-fd37f744-6a93-4146-82b1-a71250a56478 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134785 Jun 23 19:59:44.209820 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 19:59:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 19:59:44.221835 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-4a211334-166c-4e6a-a1d1-c59485ea1556 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:44.305822 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-4a211334-166c-4e6a-a1d1-c59485ea1556 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087518 Jun 23 19:59:44.306828 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 23 19:59:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 19:59:46.404911 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-fd37f744-6a93-4146-82b1-a71250a56478 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:46.405831 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-fd37f744-6a93-4146-82b1-a71250a56478 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 Jun 23 19:59:46.406231 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:59:46.463940 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-b30d8600-dd86-4966-9f7d-e4e7277d8bd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:46.601341 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-b30d8600-dd86-4966-9f7d-e4e7277d8bd7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.189378 Jun 23 19:59:46.601922 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 19:59:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 19:59:46.614582 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-3386fcc0-7af8-48c6-82a0-a31fb9d3722a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:46.731038 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-3386fcc0-7af8-48c6-82a0-a31fb9d3722a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120226 Jun 23 19:59:46.732411 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 23 19:59:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 19:59:49.000728 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-b30d8600-dd86-4966-9f7d-e4e7277d8bd7 admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:49.003159 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-b30d8600-dd86-4966-9f7d-e4e7277d8bd7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Jun 23 19:59:49.004644 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:59:49.080164 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-d11ae773-378d-452b-abe3-5f094f5acd18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "disk": 20, "rxtx_factor": 1.0}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:49.174558 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-d11ae773-378d-452b-abe3-5f094f5acd18 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163394 Jun 23 19:59:49.182211 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 19:59:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 19:59:49.188193 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-dd2bc905-20ab-4961-b430-b555e6d0fcd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:49.308596 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-dd2bc905-20ab-4961-b430-b555e6d0fcd4 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124900 Jun 23 19:59:49.309444 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 23 19:59:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 19:59:51.441509 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-d11ae773-378d-452b-abe3-5f094f5acd18 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:51.442528 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-d11ae773-378d-452b-abe3-5f094f5acd18 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 23 19:59:51.442960 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:59:51.501138 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-73e61dad-2ff8-4fde-88db-037626e48eab admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:51.524203 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-73e61dad-2ff8-4fde-88db-037626e48eab admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074774 Jun 23 19:59:51.528273 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jun 23 19:59:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 19:59:53.695925 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-d11ae773-378d-452b-abe3-5f094f5acd18 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:53.697302 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-d11ae773-378d-452b-abe3-5f094f5acd18 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001815 Jun 23 19:59:53.697709 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:59:53.769065 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-8bd7a574-f208-4d49-a4ec-3e8fe31cd56d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "name": "m1.tiny"}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:53.843119 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-8bd7a574-f208-4d49-a4ec-3e8fe31cd56d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.136907 Jun 23 19:59:53.843783 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 19:59:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 19:59:53.856736 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-78b4002d-c7ac-4133-938b-3c81e1844db5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:53.937857 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-78b4002d-c7ac-4133-938b-3c81e1844db5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084765 Jun 23 19:59:53.938397 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 23 19:59:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 19:59:56.066539 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-8bd7a574-f208-4d49-a4ec-3e8fe31cd56d admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:56.067671 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-8bd7a574-f208-4d49-a4ec-3e8fe31cd56d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 23 19:59:56.068169 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 19:59:56.132567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-13eac4d2-87b3-47fc-b160-594126f10e1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:56.218895 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-13eac4d2-87b3-47fc-b160-594126f10e1a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142671 Jun 23 19:59:56.219368 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 19:59:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 19:59:56.232623 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-ac6ed3e6-13ae-46bd-857d-9e949a60b363 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:56.332975 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-ac6ed3e6-13ae-46bd-857d-9e949a60b363 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105200 Jun 23 19:59:56.333764 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 23 19:59:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 19:59:58.441679 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-13eac4d2-87b3-47fc-b160-594126f10e1a admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 19:59:58.441679 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-13eac4d2-87b3-47fc-b160-594126f10e1a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 23 19:59:58.442751 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 19:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 19:59:58.519339 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-9c334345-65b4-412e-badd-b307d7bf3fda admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "vcpus": 2, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:58.595610 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-9c334345-65b4-412e-badd-b307d7bf3fda admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.144170 Jun 23 19:59:58.596204 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 19:59:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 19:59:58.608042 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-a7be3616-7edc-4748-ae47-30ec0a31d7c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 19:59:58.719700 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-a7be3616-7edc-4748-ae47-30ec0a31d7c5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115230 Jun 23 19:59:58.720206 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 23 19:59:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:00:00.782301 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-9c334345-65b4-412e-badd-b307d7bf3fda admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:00.783410 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-9c334345-65b4-412e-badd-b307d7bf3fda admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Jun 23 20:00:00.783826 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 20:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:00.841598 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-6cebdb9e-6674-41a6-8954-c64b403bf177 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "swap": 0, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:00:00.943535 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-6cebdb9e-6674-41a6-8954-c64b403bf177 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.153678 Jun 23 20:00:00.944612 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 20:00:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:00:00.956463 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-8ca779e4-36c1-4613-96ac-9bed0204a7ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:00:01.032936 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-8ca779e4-36c1-4613-96ac-9bed0204a7ca admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080092 Jun 23 20:00:01.033518 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 23 20:00:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:00:03.193866 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-6cebdb9e-6674-41a6-8954-c64b403bf177 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:03.195654 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-6cebdb9e-6674-41a6-8954-c64b403bf177 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002379 Jun 23 20:00:03.208499 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 20:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:03.282290 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-f5c6eb88-32eb-46c7-ae67-1e55c4087dbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "id": "5", "name": "m1.xlarge"}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:00:03.653297 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-f5c6eb88-32eb-46c7-ae67-1e55c4087dbf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449515 Jun 23 20:00:03.653898 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 23 20:00:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 20:00:03.665793 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-5f04d1d2-c5d3-4733-833e-1cec609971ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:00:03.770880 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-5f04d1d2-c5d3-4733-833e-1cec609971ac admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108705 Jun 23 20:00:03.771706 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 23 20:00:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:00:28.670283 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-f5c6eb88-32eb-46c7-ae67-1e55c4087dbf admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:28.671301 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-f5c6eb88-32eb-46c7-ae67-1e55c4087dbf admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 23 20:00:28.671706 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 20:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:28.682316 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:28.730011 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-a1dc75b3-8f28-4c55-afe3-12f63301e6d4 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:28.747003 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-a1dc75b3-8f28-4c55-afe3-12f63301e6d4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069268 Jun 23 20:00:28.747534 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jun 23 20:00:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:00:29.659754 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-f5c6eb88-32eb-46c7-ae67-1e55c4087dbf admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:29.660810 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-f5c6eb88-32eb-46c7-ae67-1e55c4087dbf admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 23 20:00:29.661209 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:29.853774 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-224e13b7-15ef-4b37-88d6-633ad42add5e admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:29.860327 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.wsgi [None req-224e13b7-15ef-4b37-88d6-633ad42add5e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-224e13b7-15ef-4b37-88d6-633ad42add5e admin admin] Request method failure captured: Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Accept: application/json Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Accept-Encoding: gzip, deflate Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Connection: keep-alive Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Content-Length: 0 Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Host: 10.222.0.44 Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Openstack-Api-Version: compute 2.90 Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Openstack-System-Scope: None Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: User-Agent: python-novaclient Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Auth-Token: gAAAAABitMZdptKuAumiHDbSFbi9mA9JDl9uqDl5nu2pyb3G94qQ9G4_EK8rcj2Ieq-nPfKjcHp6LxQJWcO-kE9wvrbKDMfoVJKkmOl1nSQI8V1E_xfQeNSvREbEYB10b-yqduwAWraV6x77xQy8p36kd5NjD9SdAFJ0MNV4tcgPGyTvfFnwS5U Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Domain-Id: None Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Domain-Name: None Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Identity-Status: Confirmed Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Is-Admin-Project: True Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Domain-Id: default Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Domain-Name: Default Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Name: admin Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Role: admin,reader,member Jun 23 20:00:29.863567 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Roles: admin,reader,member Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3c8189cd37644e9a49e850123b33202", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3c8189cd37644e9a49e850123b33202"}]}] Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Tenant: admin Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Tenant-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Tenant-Name: admin Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User: admin Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Domain-Id: default Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Domain-Name: Default Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Id: 5060168fc25744178d345904afb6c333 Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Name: admin Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: method: > Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: exception: Flavor 42 could not be found. Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: action_args: {'id': '42'} Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:00:29.875051 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:29.876129 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.877588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-224e13b7-15ef-4b37-88d6-633ad42add5e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:00:29.878860 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-224e13b7-15ef-4b37-88d6-633ad42add5e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062433 Jun 23 20:00:29.878860 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jun 23 20:00:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:29.879013 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-4d6226d5-dbbe-4895-88ce-e32861bd2e8f admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:29.879013 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:00:29.896266 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-4d6226d5-dbbe-4895-88ce-e32861bd2e8f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025141 Jun 23 20:00:29.896845 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 23 20:00:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:00:29.906943 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-91277b3c-8ce2-4771-baea-cf58e807ef8a admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:29.929503 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-91277b3c-8ce2-4771-baea-cf58e807ef8a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026067 Jun 23 20:00:29.930032 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 23 20:00:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:00:29.944791 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-7e4d7107-186a-4dbc-919a-13cb55bf0d53 admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:29.951036 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.wsgi [None req-7e4d7107-186a-4dbc-919a-13cb55bf0d53 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-7e4d7107-186a-4dbc-919a-13cb55bf0d53 admin admin] Request method failure captured: Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Accept: application/json Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Accept-Encoding: gzip, deflate Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Connection: keep-alive Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Content-Length: 0 Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Host: 10.222.0.44 Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Openstack-Api-Version: compute 2.90 Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Openstack-System-Scope: None Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: User-Agent: python-novaclient Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Auth-Token: gAAAAABitMZdptKuAumiHDbSFbi9mA9JDl9uqDl5nu2pyb3G94qQ9G4_EK8rcj2Ieq-nPfKjcHp6LxQJWcO-kE9wvrbKDMfoVJKkmOl1nSQI8V1E_xfQeNSvREbEYB10b-yqduwAWraV6x77xQy8p36kd5NjD9SdAFJ0MNV4tcgPGyTvfFnwS5U Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Domain-Id: None Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Domain-Name: None Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Identity-Status: Confirmed Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Is-Admin-Project: True Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Domain-Id: default Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Domain-Name: Default Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Name: admin Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Role: admin,reader,member Jun 23 20:00:29.954345 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Roles: admin,reader,member Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3c8189cd37644e9a49e850123b33202", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3c8189cd37644e9a49e850123b33202"}]}] Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Tenant: admin Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Tenant-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Tenant-Name: admin Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User: admin Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Domain-Id: default Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Domain-Name: Default Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Id: 5060168fc25744178d345904afb6c333 Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Name: admin Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: method: > Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: exception: Flavor 42 could not be found. Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: action_args: {'id': '42'} Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:00:29.955756 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:29.956715 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:29.958075 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-7e4d7107-186a-4dbc-919a-13cb55bf0d53 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:00:29.959337 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-7e4d7107-186a-4dbc-919a-13cb55bf0d53 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014463 Jun 23 20:00:29.959337 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jun 23 20:00:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:30.775629 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-91277b3c-8ce2-4771-baea-cf58e807ef8a admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:30.776716 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-91277b3c-8ce2-4771-baea-cf58e807ef8a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 23 20:00:30.777679 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:00:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:30.966085 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-1e1d001c-2995-4c1c-8418-69b5e695e2f1 admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:30.971934 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.wsgi [None req-1e1d001c-2995-4c1c-8418-69b5e695e2f1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-1e1d001c-2995-4c1c-8418-69b5e695e2f1 admin admin] Request method failure captured: Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Accept: application/json Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Accept-Encoding: gzip, deflate Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Connection: keep-alive Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Content-Length: 0 Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Host: 10.222.0.44 Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Openstack-Api-Version: compute 2.90 Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Openstack-System-Scope: None Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: User-Agent: python-novaclient Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Auth-Token: gAAAAABitMZeGeFcYYc4bMmj5fxe1YBw_KgMQVOAFGB4oUXm_3co2As_N-W3oLj031sVYPhM24--VR2_HKkuxo2LlxkjY4XOU66T6s7eSTDH0nyvKjTFwFsrwN5Hs9jX2vtSxn5RaDHRELoOkCbwlpFaRzvdwU64oteUjMqDf2VikP4EcvZn2gU Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Domain-Id: None Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Domain-Name: None Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Identity-Status: Confirmed Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Is-Admin-Project: True Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Domain-Id: default Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Domain-Name: Default Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Name: admin Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Role: admin,reader,member Jun 23 20:00:30.973554 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Roles: admin,reader,member Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3c8189cd37644e9a49e850123b33202", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3c8189cd37644e9a49e850123b33202"}]}] Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Tenant: admin Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Tenant-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Tenant-Name: admin Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User: admin Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Domain-Id: default Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Domain-Name: Default Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Id: 5060168fc25744178d345904afb6c333 Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Name: admin Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: method: > Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: exception: Flavor 84 could not be found. Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: action_args: {'id': '84'} Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:00:30.975184 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:30.976118 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:30.977248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-1e1d001c-2995-4c1c-8418-69b5e695e2f1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:00:30.978328 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-1e1d001c-2995-4c1c-8418-69b5e695e2f1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060179 Jun 23 20:00:30.978328 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jun 23 20:00:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:30.984937 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-9d776c8d-3b93-4ea9-b179-2848f4232797 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:30.999275 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-9d776c8d-3b93-4ea9-b179-2848f4232797 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017801 Jun 23 20:00:30.999751 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 23 20:00:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:00:31.009249 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-705e2a36-094c-4493-8b36-e4252589c5b6 admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:31.023850 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-705e2a36-094c-4493-8b36-e4252589c5b6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018310 Jun 23 20:00:31.024389 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 23 20:00:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:00:31.033553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-ed094036-8b6a-4720-ac36-843ded987c95 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:31.038789 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.wsgi [None req-ed094036-8b6a-4720-ac36-843ded987c95 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-ed094036-8b6a-4720-ac36-843ded987c95 admin admin] Request method failure captured: Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Accept: application/json Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Accept-Encoding: gzip, deflate Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Connection: keep-alive Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Content-Length: 0 Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Host: 10.222.0.44 Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Openstack-Api-Version: compute 2.90 Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Openstack-System-Scope: None Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: User-Agent: python-novaclient Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Auth-Token: gAAAAABitMZeGeFcYYc4bMmj5fxe1YBw_KgMQVOAFGB4oUXm_3co2As_N-W3oLj031sVYPhM24--VR2_HKkuxo2LlxkjY4XOU66T6s7eSTDH0nyvKjTFwFsrwN5Hs9jX2vtSxn5RaDHRELoOkCbwlpFaRzvdwU64oteUjMqDf2VikP4EcvZn2gU Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Domain-Id: None Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Domain-Name: None Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Identity-Status: Confirmed Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Is-Admin-Project: True Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Domain-Id: default Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Domain-Name: Default Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Name: admin Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Role: admin,reader,member Jun 23 20:00:31.040283 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Roles: admin,reader,member Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3c8189cd37644e9a49e850123b33202", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3c8189cd37644e9a49e850123b33202"}]}] Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Tenant: admin Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Tenant-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Tenant-Name: admin Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User: admin Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Domain-Id: default Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Domain-Name: Default Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Id: 5060168fc25744178d345904afb6c333 Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Name: admin Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: method: > Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: exception: Flavor 84 could not be found. Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: action_args: {'id': '84'} Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:00:31.041933 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:31.043553 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:31.049236 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-ed094036-8b6a-4720-ac36-843ded987c95 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:00:31.050609 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-ed094036-8b6a-4720-ac36-843ded987c95 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011608 Jun 23 20:00:31.050609 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jun 23 20:00:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 20:00:31.881641 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-705e2a36-094c-4493-8b36-e4252589c5b6 admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:31.882637 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-705e2a36-094c-4493-8b36-e4252589c5b6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 23 20:00:31.883023 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:32.072659 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-e775ec46-09d8-4490-953e-060bbab1f66f admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:32.077875 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.wsgi [None req-e775ec46-09d8-4490-953e-060bbab1f66f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-e775ec46-09d8-4490-953e-060bbab1f66f admin admin] Request method failure captured: Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Accept: application/json Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Accept-Encoding: gzip, deflate Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Connection: keep-alive Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Content-Length: 0 Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Host: 10.222.0.44 Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Openstack-Api-Version: compute 2.90 Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Openstack-System-Scope: None Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: User-Agent: python-novaclient Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Auth-Token: gAAAAABitMZf6bGSEBOZq7ESDLOVOhz-kAsQYVwkZNbeOwd9sWYYKh-FfA9wpBKSw1p2akfNsxT1PmB3XxsWe1bj3Ipw02guTxy2aHPnzffiioWDUw0V3Bv_JdaAXs5UvN2VlSE1Y9I1O1wQa_EawzJtKAq32dYCJpoPYBbskl3OeW9CysrQ5HM Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Domain-Id: None Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Domain-Name: None Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Identity-Status: Confirmed Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Is-Admin-Project: True Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Domain-Id: default Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Domain-Name: Default Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Project-Name: admin Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Role: admin,reader,member Jun 23 20:00:32.079393 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Roles: admin,reader,member Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3c8189cd37644e9a49e850123b33202", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3c8189cd37644e9a49e850123b33202"}]}] Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Tenant: admin Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Tenant-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-Tenant-Name: admin Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User: admin Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Domain-Id: default Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Domain-Name: Default Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Id: 5060168fc25744178d345904afb6c333 Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: X-User-Name: admin Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: method: > Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: exception: Flavor 451 could not be found. Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: action_args: {'id': '451'} Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:00:32.080807 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:32.081588 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.082634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-e775ec46-09d8-4490-953e-060bbab1f66f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:00:32.083636 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-e775ec46-09d8-4490-953e-060bbab1f66f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059389 Jun 23 20:00:32.083636 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 23 20:00:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:32.090848 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-a7f4d4da-4c22-45bd-a165-19cd29fed876 admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:32.104400 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-a7f4d4da-4c22-45bd-a165-19cd29fed876 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017487 Jun 23 20:00:32.104857 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 23 20:00:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:00:32.115338 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:32.128076 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016610 Jun 23 20:00:32.128610 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 23 20:00:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:00:32.137742 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-62c77af2-5321-429d-9fc9-aa42088635aa admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:32.142995 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.wsgi [None req-62c77af2-5321-429d-9fc9-aa42088635aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-62c77af2-5321-429d-9fc9-aa42088635aa admin admin] Request method failure captured: Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Accept: application/json Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Accept-Encoding: gzip, deflate Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Connection: keep-alive Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Content-Length: 0 Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Host: 10.222.0.44 Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Openstack-Api-Version: compute 2.90 Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Openstack-System-Scope: None Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: User-Agent: python-novaclient Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Auth-Token: gAAAAABitMZf6bGSEBOZq7ESDLOVOhz-kAsQYVwkZNbeOwd9sWYYKh-FfA9wpBKSw1p2akfNsxT1PmB3XxsWe1bj3Ipw02guTxy2aHPnzffiioWDUw0V3Bv_JdaAXs5UvN2VlSE1Y9I1O1wQa_EawzJtKAq32dYCJpoPYBbskl3OeW9CysrQ5HM Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Domain-Id: None Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Domain-Name: None Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Identity-Status: Confirmed Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Is-Admin-Project: True Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Domain-Id: default Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Domain-Name: Default Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Project-Name: admin Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Role: admin,reader,member Jun 23 20:00:32.144540 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Roles: admin,reader,member Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e3c8189cd37644e9a49e850123b33202", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e3c8189cd37644e9a49e850123b33202"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e3c8189cd37644e9a49e850123b33202"}]}] Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Tenant: admin Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Tenant-Id: e3c8189cd37644e9a49e850123b33202 Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-Tenant-Name: admin Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User: admin Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Domain-Id: default Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Domain-Name: Default Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Id: 5060168fc25744178d345904afb6c333 Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: X-User-Name: admin Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: method: > Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: exception: Flavor 451 could not be found. Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: action_args: {'id': '451'} Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:00:32.146088 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:32.147090 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: ERROR nova.api.openstack.wsgi Jun 23 20:00:32.148631 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-62c77af2-5321-429d-9fc9-aa42088635aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:00:32.150006 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-62c77af2-5321-429d-9fc9-aa42088635aa admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011734 Jun 23 20:00:32.150006 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 23 20:00:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 20:00:32.963995 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:32.965634 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002353 Jun 23 20:00:32.966034 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:00:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:33.154596 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-e4facaa2-629e-416a-8bbf-e3494fca2c51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:00:33.315053 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-e4facaa2-629e-416a-8bbf-e3494fca2c51 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.211699 Jun 23 20:00:33.315600 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jun 23 20:00:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:00:34.123750 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:34.124792 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 23 20:00:34.125184 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:00:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:34.310396 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-cb8eef72-c3c2-4a02-b08c-29d37d166177 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:00:34.381751 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-cb8eef72-c3c2-4a02-b08c-29d37d166177 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.121747 Jun 23 20:00:34.382218 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jun 23 20:00:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:00:35.205352 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:35.206361 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 23 20:00:35.206759 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:35.395021 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-264440ad-4168-4648-85fd-13c146a66190 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:00:35.497492 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-264440ad-4168-4648-85fd-13c146a66190 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.152967 Jun 23 20:00:35.498043 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jun 23 20:00:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:00:36.321995 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:36.323029 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Jun 23 20:00:36.323413 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:00:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:00:36.512425 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-c0659fd7-5f3d-4a9d-99e6-c28885b8dd7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:00:36.599870 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-c0659fd7-5f3d-4a9d-99e6-c28885b8dd7e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.139571 Jun 23 20:00:36.600426 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jun 23 20:00:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:00:37.419408 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:37.420446 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 23 20:00:37.420845 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:00:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:00:37.607863 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-65533f79-2587-47df-b75f-d242034b47e2 admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:00:37.626551 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-65533f79-2587-47df-b75f-d242034b47e2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069707 Jun 23 20:00:37.628612 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Thu Jun 23 20:00:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:01:24.441113 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:01:24.442512 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-676adc90-5c64-484a-b7c8-8c401d6ee8ef admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Jun 23 20:01:24.442907 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 23 20:01:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:01:24.453957 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:01:24.502229 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-125515b3-4b64-4ee8-861f-f68a6b07778b admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:01:24.522201 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-125515b3-4b64-4ee8-861f-f68a6b07778b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072618 Jun 23 20:01:24.522740 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jun 23 20:01:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:01:24.545745 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-e9f7f1a0-8dce-4b3b-aae3-d03fa13fff8e admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:01:24.549336 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_api:SELECT=14 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:01:24.554168 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-e9f7f1a0-8dce-4b3b-aae3-d03fa13fff8e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011994 Jun 23 20:01:24.554675 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Thu Jun 23 20:01:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:01:24.565704 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-f61183f5-ac79-47b8-9b31-71d80433fb9a admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:01:24.573975 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-f61183f5-ac79-47b8-9b31-71d80433fb9a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011767 Jun 23 20:01:24.574479 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Thu Jun 23 20:01:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:01:24.585611 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:01:24.593599 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011410 Jun 23 20:01:24.594098 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Thu Jun 23 20:01:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:01:24.604760 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-a96366d9-2c9e-46c9-a23d-930ebf4d2eae admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:01:24.612023 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-a96366d9-2c9e-46c9-a23d-930ebf4d2eae admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010700 Jun 23 20:01:24.612562 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Thu Jun 23 20:01:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:05:02.062016 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:05:02.067472 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 23 20:05:02.067472 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:05:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:05:02.203207 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_api:SELECT=6 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:02.316618 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-82df3be2-3c5c-43ee-b091-aa9201ee72c4 admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:05:02.317779 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 20:05:02.317779 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: warnings.warn(msg) Jun 23 20:05:02.319029 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-82df3be2-3c5c-43ee-b091-aa9201ee72c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:05:02.319468 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-82df3be2-3c5c-43ee-b091-aa9201ee72c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:05:02.320248 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-82df3be2-3c5c-43ee-b091-aa9201ee72c4 admin admin] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:05:02.320702 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-82df3be2-3c5c-43ee-b091-aa9201ee72c4 admin admin] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:05:02.354325 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-82df3be2-3c5c-43ee-b091-aa9201ee72c4 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152486 Jun 23 20:05:02.355505 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 23 20:05:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:05:03.184317 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:05:03.185330 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 23 20:05:03.185749 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:05:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:05:03.382084 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-aa514c20-49e4-4c5e-b2cb-612b7852b16e admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:05:03.383251 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 20:05:03.383251 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: warnings.warn(msg) Jun 23 20:05:03.384477 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-aa514c20-49e4-4c5e-b2cb-612b7852b16e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:05:03.384917 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-aa514c20-49e4-4c5e-b2cb-612b7852b16e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:05:03.385709 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-aa514c20-49e4-4c5e-b2cb-612b7852b16e admin admin] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:05:03.386842 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-aa514c20-49e4-4c5e-b2cb-612b7852b16e admin admin] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:05:03.408186 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-aa514c20-49e4-4c5e-b2cb-612b7852b16e admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078024 Jun 23 20:05:03.408734 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 23 20:05:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:05:14.641434 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:05:14.642513 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 23 20:05:14.642911 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:05:14.785354 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_cell0:SELECT=4 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:14.786073 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_cell1:SELECT=4 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:14.786678 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG dbcounter [-] [103811] Writing DB stats nova_api:SELECT=8 {{(pid=103811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:05:14.834594 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-57085428-6cd8-40cb-ac95-0df15e54cd6c admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:05:14.836073 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 20:05:14.836073 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: warnings.warn(msg) Jun 23 20:05:14.837292 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-57085428-6cd8-40cb-ac95-0df15e54cd6c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:05:14.837744 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-57085428-6cd8-40cb-ac95-0df15e54cd6c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:05:14.838570 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-57085428-6cd8-40cb-ac95-0df15e54cd6c admin admin] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:05:14.839004 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-57085428-6cd8-40cb-ac95-0df15e54cd6c admin admin] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:05:14.865436 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-57085428-6cd8-40cb-ac95-0df15e54cd6c admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085349 Jun 23 20:05:14.865919 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 23 20:05:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:05:15.691001 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:05:15.692014 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-4f89a954-ad94-43ac-8ee3-55275557491f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 23 20:05:15.692446 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 23 20:05:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:05:15.882268 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG nova.api.openstack.wsgi [None req-94209d44-792e-4691-bd26-c8170df7fe2b admin admin] Calling method '>' {{(pid=103811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:05:15.883424 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 20:05:15.883424 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: warnings.warn(msg) Jun 23 20:05:15.884890 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-94209d44-792e-4691-bd26-c8170df7fe2b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:05:15.885376 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-94209d44-792e-4691-bd26-c8170df7fe2b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:05:15.886339 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-94209d44-792e-4691-bd26-c8170df7fe2b admin admin] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:05:15.886765 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: DEBUG oslo_concurrency.lockutils [None req-94209d44-792e-4691-bd26-c8170df7fe2b admin admin] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:05:15.909522 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: INFO nova.api.openstack.requestlog [None req-94209d44-792e-4691-bd26-c8170df7fe2b admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079106 Jun 23 20:05:15.910050 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: [pid: 103811|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 23 20:05:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:06:11.612876 dv-cinder-847274-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 20:06:11.613441 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: Thu Jun 23 20:06:11 2022 - graceful shutdown triggered... Jun 23 20:06:11.613922 dv-cinder-847274-2-iscsi devstack@n-api.service[103812]: Gracefully killing worker 2 (pid: 103812)... Jun 23 20:06:11.614279 dv-cinder-847274-2-iscsi devstack@n-api.service[103811]: Gracefully killing worker 1 (pid: 103811)... Jun 23 20:06:12.614902 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: worker 1 buried after 1 seconds Jun 23 20:06:12.615524 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: worker 2 buried after 1 seconds Jun 23 20:06:12.615524 dv-cinder-847274-2-iscsi devstack@n-api.service[103810]: goodbye to uWSGI. Jun 23 20:06:12.616538 dv-cinder-847274-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 20:06:12.617101 dv-cinder-847274-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 20:06:12.619847 dv-cinder-847274-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 20:06:12.630719 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 20:06:12 2022] *** Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: nodename: dv-cinder-847274-2-iscsi Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: machine: x86_64 Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: clock source: unix Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: pcre jit disabled Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: detected number of CPU cores: 4 Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: current working directory: / Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: detected binary path: /usr/bin/uwsgi-core Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: your processes number limit is 47680 Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: your memory page size is 4096 bytes Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: detected max file descriptor number: 2048 Jun 23 20:06:12.633419 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: lock engine: pthread robust mutexes Jun 23 20:06:12.634516 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: thunder lock: enabled Jun 23 20:06:12.634516 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 20:06:12.634516 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 20:06:12.676552 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: Python main interpreter initialized at 0x563d3d8619c0 Jun 23 20:06:12.676552 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: python threads support enabled Jun 23 20:06:12.676552 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: your server socket listen backlog is limited to 100 connections Jun 23 20:06:12.676552 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: your mercy for graceful operations on workers is 90 seconds Jun 23 20:06:12.677493 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 20:06:12.677493 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: *** Operational MODE: preforking *** Jun 23 20:06:12.677738 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: *** uWSGI is running in multiple interpreter mode *** Jun 23 20:06:12.677738 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: spawned uWSGI master process (pid: 118334) Jun 23 20:06:12.677932 dv-cinder-847274-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 20:06:12.679029 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: spawned uWSGI worker 1 (pid: 118345, cores: 1) Jun 23 20:06:12.679029 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: spawned uWSGI worker 2 (pid: 118346, cores: 1) Jun 23 20:06:12.679029 dv-cinder-847274-2-iscsi devstack@n-api.service[118334]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 20:06:13.346982 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 20:06:13.348104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 20:06:14.552116 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 20:06:14.552116 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: from cryptography.utils import int_from_bytes Jun 23 20:06:14.552815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 20:06:14.552815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: from cryptography.utils import int_from_bytes Jun 23 20:06:14.571086 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 20:06:14.571086 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: from cryptography.utils import int_from_bytes Jun 23 20:06:14.571935 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 20:06:14.571935 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: from cryptography.utils import int_from_bytes Jun 23 20:06:16.991211 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 20:06:16.991896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 20:06:16.991996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 20:06:16.992403 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 20:06:16.992668 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 20:06:16.993063 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.993396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.993725 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.994050 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.994385 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.994702 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.995029 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.995351 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.995681 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.995944 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.996266 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.996637 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847274-2-iscsi {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.996967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.997281 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.997389 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 20:06:16.997739 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 20:06:16.997833 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.997913 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.998101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 20:06:16.998199 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.998428 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 20:06:16.998585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.998686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 20:06:16.998887 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.999053 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.999319 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.999456 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.999701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:16.999996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.000333 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.000655 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.000977 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.001152 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.001348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.001556 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.001684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.001878 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.002002 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.002202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.002325 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.002525 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847274-2-iscsi {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.002639 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.002828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.003009 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.003146 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.003331 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.003439 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.003643 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.003764 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.003971 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.004099 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.004313 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.004430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.004634 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.004769 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847274-2-iscsi {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.005153 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.005281 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.005486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.005612 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.005808 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.005941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.006131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.006346 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.006582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.006792 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.007022 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.007022 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.007438 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.007669 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.007669 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.008073 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.008338 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.008543 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.008700 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.008887 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.009050 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847274-2-iscsi {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.009207 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.009373 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.009528 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.009719 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.009869 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.010023 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.010184 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.010184 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.010488 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.010488 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.010767 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.010912 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.011139 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.011300 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.011454 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.011608 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.011761 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.011908 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.012068 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.012217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.012399 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.012571 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.012720 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.012879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.013035 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.013181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.013181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.013475 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.013629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.013789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.013946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.014102 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.014102 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.014397 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.014558 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.015236 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.015236 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.015541 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.015697 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.015856 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.016014 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.016162 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.016348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.016503 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.016649 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.016818 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.016983 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.016983 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.017295 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.017442 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.017598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.017754 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.017912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.018069 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.018069 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.018357 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.018517 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.018517 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.018819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.018974 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.019121 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.019278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.019432 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.019593 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.019593 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.019890 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.020046 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.020204 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.020420 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.020598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.020755 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.020910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.021063 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.021218 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.021379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.021379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.021667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.021667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.021952 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.021952 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.022252 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.022416 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.022565 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.022718 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.022874 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.023021 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.023181 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.023334 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.023481 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.023627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.023780 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.023945 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.024092 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.024248 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.024480 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.024637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.024785 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.024946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.025099 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.025253 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.025410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.025565 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.025712 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.025871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.026027 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.026181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.026328 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.026499 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.026648 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.026822 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.026981 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.027142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.027302 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.027456 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.027609 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.027770 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.027770 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.027770 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.028188 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.028375 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.028552 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.028699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.028699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.028984 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.029138 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.029293 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.029518 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.029668 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.029824 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.029978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.030133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.030280 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.030436 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.030608 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.030756 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.030902 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.031056 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.031056 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.031356 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.031511 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.031666 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.031820 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.031974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.032144 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.032294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.032528 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.032686 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.032834 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.032988 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.033135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.033297 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.033452 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.033452 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.033737 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.033883 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.034045 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.034191 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.034346 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.034503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.034503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.034797 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.034961 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.035115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.035271 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.035419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.035571 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.035724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.035879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.036576 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.036743 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.036899 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.037057 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.037203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.037363 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.037363 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.037650 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.037808 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.037955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.038115 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.038115 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.038393 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.038540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.038697 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.038851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.039017 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.039164 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.039319 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.039467 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.039614 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.039760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.039915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.040062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.040216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.040384 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.040547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.040697 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.040697 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.041003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.041150 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.041304 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.041457 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.041613 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.041767 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.041923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.042076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.042223 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.042386 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.042550 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 20:06:17.042699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.042856 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.043010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.043166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.043314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.043472 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.043618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.043772 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.043926 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.044082 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.044237 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.044421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.044570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.044736 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.044894 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.045048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.045212 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.045365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.045511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.045658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.045804 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.045957 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.046117 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.046264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.046424 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.046581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.046739 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.046888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.047035 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.047193 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.047423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.047577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.047741 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.048040 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.048194 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.048419 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.048580 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.048761 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.048923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.049093 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.049249 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.049410 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.049566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.049715 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.049870 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.050033 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.050191 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.050345 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.050492 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.050638 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.050871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.051024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.051196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.051351 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.051506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.051709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.052405 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.052623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.052795 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.052951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.053108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.053298 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.053457 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.053613 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.053781 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.053937 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.054091 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.054240 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.054386 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.054546 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.054700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.054847 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.055000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.055147 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.055294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.055454 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.055611 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.055776 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.055923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.056069 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.056222 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.056476 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.056629 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.056776 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.056929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.057075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.057221 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.057383 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.057538 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.057815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.057977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.058140 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.058300 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.058455 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.058713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.058874 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.059029 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.059175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.059336 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.059485 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.059630 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.059808 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.059962 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.060126 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.060288 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.060511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.060657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.060815 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.060963 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.061146 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.061310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.061468 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.061617 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.061763 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.061917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.062072 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.062238 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.062393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.062540 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.062688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.062834 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.062990 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.063230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.063451 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.063606 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.063802 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.063971 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.064132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.064914 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.065077 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.065225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.065379 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.065527 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.065688 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.065837 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.065985 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.066139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.066287 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.066442 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.066590 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.066743 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.066903 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.067057 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.067212 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.067404 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.067554 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.067700 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.067855 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.068012 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.068012 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.068012 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.068489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.068648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.068795 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.068960 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.069108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.069263 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.069263 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.069550 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.069704 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.069851 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.070005 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.070162 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.070310 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.070463 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.070610 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.070765 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.070926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.071075 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.071222 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.071376 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.071524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.071524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.072079 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.072236 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.072410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.072568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.072723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.072877 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.073051 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.073208 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.073356 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.073502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.073655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.073811 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.074810 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.074981 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075297 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075456 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075665 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075739 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075834 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075834 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.075992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.076231 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.076532 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.076759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.076867 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.077154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.077354 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.077461 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.077768 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.077952 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.078092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.078405 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.078509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.078726 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.079015 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.079118 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.079332 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.079588 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.079693 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.079992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.080176 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.080341 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.080654 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.080757 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.080965 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.081264 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.081365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.081575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.081836 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.081932 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.082180 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.082400 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.082496 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.082797 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.083041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.083139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.083436 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.083609 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.083747 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.084071 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.084216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.084426 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.084762 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.084859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.085156 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.085343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.085475 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.085806 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.085928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.086144 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.086432 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.086536 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.086752 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.087019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.087114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.087372 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.087603 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.087707 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.087977 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.088208 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.088330 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.088602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.088824 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.088919 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.089212 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.089405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.089522 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.089832 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.090005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.090136 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.090448 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.090574 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.090756 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.091061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.091187 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.091365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.091676 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.091777 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.091997 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.092281 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.092471 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.092665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.092902 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.092998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.093277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.093512 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.093617 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.093886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.094094 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.094197 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.094484 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.094685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.094788 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.095078 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.095302 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.095423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.095736 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.095931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.096033 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.096372 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.096551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.096694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.097003 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.097145 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.097318 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.097627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.097728 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.097937 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.098228 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.098336 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.099080 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.099348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.099444 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.099687 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.099931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.100027 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.100307 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.100538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.100632 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.100950 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.101117 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.101258 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.101568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.101722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.101880 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.102182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.102290 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.102493 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.102809 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.102909 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.103307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.103398 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.104365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.104365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.104572 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.104661 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.104661 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.104972 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.105076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.105304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.105596 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.105702 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.105967 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.106178 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.106287 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.106583 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.106772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.106876 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.107180 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.107393 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.107496 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.107781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.108001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.108105 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.108398 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.108618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.108713 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.108993 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.109199 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.109295 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.109588 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.109803 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.109898 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.110186 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.110386 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.110502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.110789 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.110975 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.111079 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.111398 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.111551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.111707 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.112011 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.112112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.112326 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.112632 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.112736 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.112975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.113223 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.113319 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.113608 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.113804 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.113938 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.114819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.114946 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.115126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.115431 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.115534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.115754 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.116007 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.116102 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.116377 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.116628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.116725 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.116981 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.117209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.117305 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.117577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.117784 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.117887 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.118182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.118370 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.118492 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.118800 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.118956 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.119101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.119408 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.119546 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.119709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.120023 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.120127 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.120353 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.120658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.120766 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.120955 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.121261 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.121410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.121568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.121846 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.121949 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.122164 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.122429 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.122525 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.122766 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.123021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.123116 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.123359 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.123606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.123708 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.123958 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.124186 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.124288 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.124579 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.124795 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.124899 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.125199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.125375 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.125499 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.125804 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.126030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.126135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.126405 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.126615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.126711 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.127001 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.127192 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.127321 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.127637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.127785 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.127941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.128250 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.128421 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.128834 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.129262 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.129356 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.129577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.129871 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.129977 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.130212 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.130453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.130547 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.130816 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.131093 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.131211 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.131416 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.132078 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.132181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.132277 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.132413 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.132413 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.132650 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.132851 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.132948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.133243 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.133443 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.133885 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.134017 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.134311 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.134419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.134773 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.135013 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.135135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.135428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.135533 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.135752 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.136018 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.136115 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.136393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.136641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.136738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.137016 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.137216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.137325 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.137635 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.137797 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.137952 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.138259 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.138361 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.138567 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.138892 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.139206 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.139301 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.139520 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.139829 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.140008 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.140154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.140446 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.140546 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.140796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.141036 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.141160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.141406 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.141646 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.141744 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.142011 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.142240 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.142350 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.142620 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.142848 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.142944 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.143235 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.143443 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.143552 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.143848 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.144063 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.144157 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.144711 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.144825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.144928 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.145157 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.145275 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.145940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.146246 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.146350 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.146548 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.146827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.146922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.147153 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.147427 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.147572 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.147753 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.147978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.148393 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.148591 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.148720 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.148929 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.149082 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.149233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.149387 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.149537 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.149691 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.149863 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.150021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.150171 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.150329 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.150479 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.150630 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.150776 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.150926 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.151080 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.151232 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.151420 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.151575 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.151731 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.151888 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.152040 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.152182 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.152360 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.152517 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.152674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.152831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.152982 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.153161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.153305 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.153483 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.153631 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.153793 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.153954 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.154137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.154283 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.154488 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.154815 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.154973 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.155135 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.155300 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.155441 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.155592 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.155745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.155745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.156051 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.156196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.156402 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.156545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.156686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.156842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.156996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.157142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.157294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.157438 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.157587 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.157744 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.157887 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.158042 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.158184 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.158326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.158474 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.158631 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.158774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.158924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.159066 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.159216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.159366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.159518 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.159668 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.159817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.159971 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.160115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.160271 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.160435 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.160588 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.160732 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.160874 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.161066 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.161725 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.161890 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.162031 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.162184 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.162340 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.162489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.162650 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.162794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.162944 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.163094 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.163270 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.163431 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.163577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.163726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.163897 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.164038 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.164228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.164412 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.164560 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.164730 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.164957 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.165102 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.165254 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.165408 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.165551 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.165697 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.165839 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.165988 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.166137 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.166293 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.166454 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.166596 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.166738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.166885 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.167036 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.167177 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.167328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.167426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.167606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.167753 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.167933 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.168075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.168257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.168380 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.168652 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.169029 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.169349 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.169441 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.169673 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.169758 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.169987 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.170071 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.170290 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.170374 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.170601 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.170684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.170909 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.171076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.171217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.171302 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.171523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.171614 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.171829 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.172009 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.172181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.172273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.172520 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.172615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.172843 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.172937 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.173255 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.173359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.173505 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.173589 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.173814 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.173908 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.174120 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.174222 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.174461 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.174545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.174777 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.174872 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.175144 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.175279 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.175456 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.175597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.175779 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.175904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.176104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.176198 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.176447 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.176562 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.176790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.176896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.177112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.177207 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.177424 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.177526 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.177736 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.177832 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.178039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.178135 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.178344 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.178453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.178648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.178743 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.178957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.179062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.179261 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.179372 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.179582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.179677 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.179891 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.180000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.180196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.180315 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.180525 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.180638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.180828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.180933 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.181165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.181257 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.181469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.181562 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.181780 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.181887 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.182099 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.182233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.182417 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.182523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.182731 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.182836 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.183047 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.183150 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.183365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.183460 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.183683 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.183787 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.183999 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.184100 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.184345 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.184445 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.184650 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.184754 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.184966 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.185087 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.185277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.185381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.185593 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.186015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.186258 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.186352 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.186598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.186706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.186918 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.187023 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.187232 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.187494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.187597 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.187824 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.187934 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.188140 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.188244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.188478 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.188583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.188791 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.188957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.189104 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.189280 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.189414 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.189599 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.189709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.189911 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.190066 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.190228 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.190324 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.190548 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.190658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.190871 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.190966 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.191194 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.191290 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.191511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.191615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.191845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.191946 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.192159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.192283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.192520 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.192615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.192835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.192931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.193149 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.193243 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.193506 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.193602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.193815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.193919 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.194121 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.194229 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.194434 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.194536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.194742 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.194836 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.195051 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.195202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.195361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.195466 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.195670 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.195772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.195978 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.196119 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.196287 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.196509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.196600 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.197056 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.197222 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.197323 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.197469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.197722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.197817 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.198039 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.198148 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.198355 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.198451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.198684 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.198786 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.199005 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.199109 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.199317 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.199414 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.199631 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.199726 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.199952 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.200143 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.200267 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.200490 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.200621 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.200823 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.200954 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.201149 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.201273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.201474 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.201598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.201790 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.201895 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.202110 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.202230 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.202438 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.202541 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.202743 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.202868 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.203048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.203197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.203361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.203616 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.203723 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.203944 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.204046 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.204261 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.204396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.204592 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.204704 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.204895 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.204990 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.205216 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.205319 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.205527 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.205632 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.205842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.206062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.206206 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.206426 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.206568 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.206722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.206848 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.207048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.207276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.207400 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.207508 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.207680 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.207782 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.208523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.208641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.208835 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.208941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.209145 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.209238 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.209450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.209546 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.209767 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.209873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.210082 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.210176 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.210389 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.210503 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.210694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.210799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.211005 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.211100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.211313 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.211407 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.211618 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.211723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.211927 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.212022 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.212232 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.212348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.212571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.212675 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.212884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.212979 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.213192 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.213286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.213497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.213600 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.213808 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.213902 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.214112 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.214207 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.214416 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.214511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.214719 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.214813 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.215020 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.215124 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.215332 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.215428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.215637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.215733 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.215947 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.216051 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.216250 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.216395 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.216672 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.216791 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.216981 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.217086 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.217338 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.217482 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.217606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.217710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.217885 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.217996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.218194 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.218296 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.218509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.218605 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.218817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.218921 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.219129 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.219229 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.219437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.219531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.219749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.219843 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.220059 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.220155 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.220404 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.220504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.220722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.220818 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.221031 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.221262 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.221358 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.221599 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.221708 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.221922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.222025 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.222255 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.222357 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.222588 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.222685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.222895 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.222998 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.223203 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.223306 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.223546 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.224139 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.224382 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.224495 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.224699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.224802 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.225012 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.225116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.225323 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.225419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.225696 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.225849 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.225979 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.226094 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.226243 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.226378 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.226554 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.226775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.226900 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.227015 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.227159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.227286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.227502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.227645 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.227762 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.227877 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.228071 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.228205 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.228403 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.228673 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.228807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.229007 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.229130 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.229325 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.229465 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.229641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.229764 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.229953 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.230084 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.230268 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.230401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.230577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.230707 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.230886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.231011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.231197 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.231330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.231506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.231638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.231817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.231948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.232146 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.232360 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.232498 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.232615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.232779 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.232908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.233145 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.233297 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.233466 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.233609 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.233784 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.233915 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.234101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.234244 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.234421 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.234559 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.234781 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.234916 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.235099 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.235232 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.235408 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.235549 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.235738 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.235956 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.236085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.236199 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.236368 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.236504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.236687 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.236914 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.237042 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.237165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.237301 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.237426 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238087 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238269 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238363 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238363 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238625 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238719 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.238901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.239106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.239249 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.239431 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.239527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.239733 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.239830 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.240043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.240139 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.240368 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.240485 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.240672 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.240777 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.240975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.241216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.241311 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.241534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.241636 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.241859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.242005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.242162 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.242262 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.242462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.242559 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.242764 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.242869 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.243065 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.243161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.243369 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.243464 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.243676 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.243772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.243980 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.244075 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.244282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.244398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.244605 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.244709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.244908 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.245002 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.245210 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.245312 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.245540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.245636 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.245846 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.245963 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.246173 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.246280 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.246485 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.246588 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.246892 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.247090 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.247198 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.247451 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.247547 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.247775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.247868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.248107 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.248210 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.248451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.248561 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.248808 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.248910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.249075 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.249183 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.249392 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.249509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.249703 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.249799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.250012 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.250112 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.250318 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.250414 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.250628 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.250731 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.250937 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.251048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.251245 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.251339 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.251562 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.251658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.251878 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.252189 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.252361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.252528 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.252624 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.252846 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.252942 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.253166 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.253269 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.253474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.253569 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.253783 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.253884 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.254093 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.254189 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.254406 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.254507 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.254714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.254845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.255045 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.255140 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.255352 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.255453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.255658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.255766 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.255970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.256064 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.256276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.256391 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.256615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.256721 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.256926 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.257035 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.257241 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.257348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.257546 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.257641 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.257857 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.257953 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.258214 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.258323 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.258542 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.258645 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.258853 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.258949 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.259160 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.259261 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.259483 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.259603 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.259798 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.259917 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.260114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.260216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.260378 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 20:06:17.260477 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.260755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.261105 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.261426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.261966 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.262303 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.262635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.262974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.263308 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.263621 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.263929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.264236 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.264585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.264899 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.265214 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.265528 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.265844 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.266158 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.266471 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.266782 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.267097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.267409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.267722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.268033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.268365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.268680 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.268997 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.269342 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.269666 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.269987 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.270306 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.271149 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.271465 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.271779 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.272093 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.272430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.272759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.273094 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.273410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.273721 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.274240 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.274561 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.274886 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.275219 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.275534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.275860 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.276189 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.276532 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.276858 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.277173 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.277510 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.277851 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.278185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.278513 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.278824 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.279132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.279440 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.279761 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.280081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.280428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.280740 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.281047 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.281359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.281667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.281975 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.282282 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.282597 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.282908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.283215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.283521 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.283828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.284133 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.284463 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.284774 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.285087 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.285395 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.285703 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.286030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.286890 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.287198 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.287537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.287876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.288195 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.288548 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.288866 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.289187 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.289505 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.289829 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.290154 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.290474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.290789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.291128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.291442 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.291757 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.292072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.292409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.292735 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.293050 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.293381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.293713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.294024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.294354 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.294680 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.295004 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.295324 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.295640 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.295974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.296287 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.296619 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.296940 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.297253 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.297585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.297885 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.298202 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.298532 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.298870 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.299169 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.299497 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.299825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.300174 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.300513 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.300864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.301193 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.301510 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.301869 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.302178 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 20:06:17.302423 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 20:06:17.324094 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO dbcounter [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Registered counter for database nova_api Jun 23 20:06:17.344912 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_db.sqlalchemy.engines [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 20:06:17.351891 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writer thread running {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 20:06:17.365684 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO dbcounter [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Registered counter for database nova_api Jun 23 20:06:17.385473 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 20:06:17.391928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writer thread running {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 20:06:17.407541 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.context [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c482a6c1-3f12-412c-9ae5-5047910964a9(cell1) {{(pid=118345) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 20:06:17.412261 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:06:17.414005 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:06:17.414798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:06:17.416777 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:06:17.418760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO dbcounter [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Registered counter for database nova_cell0 Jun 23 20:06:17.422780 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO dbcounter [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Registered counter for database nova_cell1 Jun 23 20:06:17.429929 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_db.sqlalchemy.engines [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 20:06:17.432148 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_db.sqlalchemy.engines [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 20:06:17.437133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writer thread running {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 20:06:17.439653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writer thread running {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 20:06:17.453574 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.context [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c482a6c1-3f12-412c-9ae5-5047910964a9(cell1) {{(pid=118346) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 20:06:17.457707 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:06:17.459816 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:06:17.460654 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:06:17.462600 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:06:17.464606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO dbcounter [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Registered counter for database nova_cell0 Jun 23 20:06:17.468677 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO dbcounter [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Registered counter for database nova_cell1 Jun 23 20:06:17.477491 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 20:06:17.478215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 20:06:17.484142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writer thread running {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 20:06:17.486288 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writer thread running {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 20:06:17.588892 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO dbcounter [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Registered counter for database nova_cell0 Jun 23 20:06:17.596515 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_db.sqlalchemy.engines [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 20:06:17.600913 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writer thread running {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 20:06:17.639599 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO dbcounter [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Registered counter for database nova_cell0 Jun 23 20:06:17.647600 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 20:06:17.652292 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writer thread running {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 20:06:17.925530 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: WARNING keystonemiddleware.auth_token [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 20:06:17.933542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: WARNING keystonemiddleware.auth_token [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 20:06:17.969557 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: WARNING keystonemiddleware.auth_token [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 20:06:17.976963 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: WARNING keystonemiddleware.auth_token [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 20:06:18.292568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: WARNING keystonemiddleware.auth_token [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 20:06:18.298685 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: WARNING keystonemiddleware.auth_token [None req-189516b1-62e2-4bef-84b3-5ff36064112f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 20:06:18.304159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d3d8619c0 pid: 118345 (default app) Jun 23 20:06:18.320171 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: WARNING keystonemiddleware.auth_token [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 20:06:18.326426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: WARNING keystonemiddleware.auth_token [None req-d9a25168-d20d-4475-a0df-f678aceeff49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 20:06:18.331738 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d3d8619c0 pid: 118346 (default app) Jun 23 20:07:13.421539 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:13.423101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:13.425305 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:13.428812 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:14.759499 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=3 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:14.774483 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=3 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:14.782575 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=3 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:14.782575 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=3 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:15.780122 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-17ea3b9b-a30b-400f-9797-8141ec61a7d4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: .version_select at 0x7f90dbdca700>, body: {"keypair": {"name": "tempest-keypair-1566955098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8/rEU3IvBuoa05GD5OsroKrMQaNvlt/XgZy2gdQvxZulgFPFiYyPf2Fnq7iNd9vztBwBe8HhON7CUsJWSKKfQ5hMMchnxvhaxexrY3lbuXgcjzawIX36kWE6z8x5htCA=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:15.897909 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-17ea3b9b-a30b-400f-9797-8141ec61a7d4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for project bd810755b80346ae9219a2d0c61a8a06. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:07:15.919810 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-17ea3b9b-a30b-400f-9797-8141ec61a7d4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for user 8a5b19c8c0d44e1f93bb1dea72884cc3 and project bd810755b80346ae9219a2d0c61a8a06. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:07:16.116567 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-17ea3b9b-a30b-400f-9797-8141ec61a7d4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 2.702759 Jun 23 20:07:16.117914 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:07:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 2709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:07:16.561569 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-315200078", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:16.627878 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-158c2f8a-2de2-4b1a-becd-048ae3847bd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'create', calling method: .version_select at 0x7f90dbc8f790>, body: {"keypair": {"name": "tempest-keypair-500894860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcEjnshN0shvY8Y0zqGCKgzc58XmRtlcmK/oLRhLLHjDJepu5LAWqsVHBbR5oPSx9d8LF/H6v8T/Q61fm8HKqTsC9/y1flvExyEq3L7au5t6hSDHeWZW/Vv0KRN5/40Dw=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:16.668030 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-158c2f8a-2de2-4b1a-becd-048ae3847bd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Getting quotas for project 71c9cca288b34019947e55d2a3112ddb. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:07:16.682107 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-158c2f8a-2de2-4b1a-becd-048ae3847bd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Getting quotas for user a3be90df779b4ddb8639d825fcb41234 and project 71c9cca288b34019947e55d2a3112ddb. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:07:16.827200 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-158c2f8a-2de2-4b1a-becd-048ae3847bd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.486966 Jun 23 20:07:16.827793 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 2/2] 10.222.0.44 () {62 vars in 1199 bytes} [Thu Jun 23 20:07:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 488 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 20:07:17.303846 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1152110942", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "networks": [{"uuid": "99083d0d-c2fb-4de1-b837-38ec56d86bfa"}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:17.516042 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] validate_networks() for [('080ae0a2-412d-4942-8b59-3cac39c039b1', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:07:19.423672 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] validate_networks() for [('99083d0d-c2fb-4de1-b837-38ec56d86bfa', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:07:20.080117 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:07:20.082056 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:07:20.082603 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:07:20.083249 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:07:20.083732 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:07:20.104657 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:20.106125 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:20.108222 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:20.115052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:20.197655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Getting quotas for project bf37c9d0240b48078038d70f678a93eb. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:07:20.210637 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Getting quotas for user f041449191c94a5ca5a38c29dd146a15 and project bf37c9d0240b48078038d70f678a93eb. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:07:20.243227 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:07:20.246358 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:07:20.433246 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7a9986b8-b241-46f1-9c25-89c3694a5f6a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.691477 Jun 23 20:07:20.436428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:07:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 5696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:07:20.459515 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-238a5869-1889-4b3b-91fc-0a0b828b25f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:20.460217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-238a5869-1889-4b3b-91fc-0a0b828b25f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:20.925198 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-238a5869-1889-4b3b-91fc-0a0b828b25f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:20.981480 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-238a5869-1889-4b3b-91fc-0a0b828b25f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1221 microversion: 2.1 time: 0.539671 Jun 23 20:07:20.994745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:20 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1221 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:21.291501 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1142852979", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:21.378138 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:07:21.378686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:07:21.379266 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:07:21.379693 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:07:21.380131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:07:21.419721 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] validate_networks() for [('080ae0a2-412d-4942-8b59-3cac39c039b1', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:07:21.433305 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:21.434182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:21.438369 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:21.441911 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:21.523767 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Getting quotas for project 32672f6e771b4d37986e48e0091b6877. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:07:21.537212 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Getting quotas for user 5645338e8194426eac77359c0cb233f5 and project 32672f6e771b4d37986e48e0091b6877. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:07:21.561175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:07:21.568517 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:07:21.767975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ddf5c967-3c4d-430b-984f-0d67d3ec7bac tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.784479 Jun 23 20:07:21.770375 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 3/5] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:07:21.781985 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2d608512-a090-4528-b194-e2258f004c7d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:21.782508 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2d608512-a090-4528-b194-e2258f004c7d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:22.214284 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2d608512-a090-4528-b194-e2258f004c7d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:22.254894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2d608512-a090-4528-b194-e2258f004c7d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1215 microversion: 2.1 time: 0.469119 Jun 23 20:07:22.260858 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 4/6] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:21 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1215 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:22.384359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:07:22.385227 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:07:22.385905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:07:22.386604 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:07:22.387009 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:07:22.402434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:22.403743 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:22.404027 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:22.404771 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:22.435280 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Getting quotas for project bf37c9d0240b48078038d70f678a93eb. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:07:22.441063 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Getting quotas for user f041449191c94a5ca5a38c29dd146a15 and project bf37c9d0240b48078038d70f678a93eb. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:07:22.454600 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:07:22.457598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:07:22.637294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-442d00e8-1a6a-452b-9b9c-52d3c76f9502 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.349265 Jun 23 20:07:22.638258 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 3/7] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:07:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:07:22.651992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-67fd96d8-c3ea-49ab-8ac6-b9cec73b0256 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:22.652690 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-67fd96d8-c3ea-49ab-8ac6-b9cec73b0256 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:22.974694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-67fd96d8-c3ea-49ab-8ac6-b9cec73b0256 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:22.981899 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-67fd96d8-c3ea-49ab-8ac6-b9cec73b0256 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1222 microversion: 2.1 time: 0.336306 Jun 23 20:07:22.994869 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 5/8] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:22 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1222 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:23.209139 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-71585707", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2163b477-2f70-4f87-a2ba-0f833320ac92"}], "security_groups": [{"name": "tempest-securitygroup--457631129"}], "key_name": "tempest-keypair-1566955098", "user_data": "}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:23.278066 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ae84e15a-9b72-4742-8969-62ae20f41f42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:23.279172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ae84e15a-9b72-4742-8969-62ae20f41f42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:23.421015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ae84e15a-9b72-4742-8969-62ae20f41f42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:23.457478 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ae84e15a-9b72-4742-8969-62ae20f41f42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1215 microversion: 2.1 time: 0.183198 Jun 23 20:07:23.470491 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 6/9] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:23 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:23.569910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] validate_networks() for [('2163b477-2f70-4f87-a2ba-0f833320ac92', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:07:23.999595 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3a925ab2-437f-48ce-8e9c-9de091cbc8c5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:24.000244 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3a925ab2-437f-48ce-8e9c-9de091cbc8c5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:24.120184 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a925ab2-437f-48ce-8e9c-9de091cbc8c5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:24.141105 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3a925ab2-437f-48ce-8e9c-9de091cbc8c5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1222 microversion: 2.1 time: 0.143890 Jun 23 20:07:24.144673 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 7/10] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:23 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:24.206801 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1286923142", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "692ee610-d0ae-4057-8e1c-c034fd73ff05"}], "security_groups": [{"name": "tempest-securitygroup--324031004"}], "key_name": "tempest-keypair-500894860", "user_data": "}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:24.486210 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] validate_networks() for [('692ee610-d0ae-4057-8e1c-c034fd73ff05', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:07:24.535855 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:07:24.536807 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:07:24.537560 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:07:24.540279 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:07:24.545468 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:07:24.568065 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:24.569175 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:24.569997 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:24.582554 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:24.615631 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for project bd810755b80346ae9219a2d0c61a8a06. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:07:24.621618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for user 8a5b19c8c0d44e1f93bb1dea72884cc3 and project bd810755b80346ae9219a2d0c61a8a06. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:07:24.638971 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:07:24.641426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:07:24.825185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a4921d31-526f-4e13-9ad0-adfc61e0de3e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.626436 Jun 23 20:07:24.827754 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 4/11] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:07:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:07:24.836500 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-99433ec7-050c-4ebb-a273-efaa42453626 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:24.837365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-99433ec7-050c-4ebb-a273-efaa42453626 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:24.847411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99433ec7-050c-4ebb-a273-efaa42453626 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:24.848041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99433ec7-050c-4ebb-a273-efaa42453626 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:24.849264 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99433ec7-050c-4ebb-a273-efaa42453626 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:24.850226 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99433ec7-050c-4ebb-a273-efaa42453626 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:25.309537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-99433ec7-050c-4ebb-a273-efaa42453626 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:25.329206 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-99433ec7-050c-4ebb-a273-efaa42453626 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1219 microversion: 2.1 time: 0.499475 Jun 23 20:07:25.347539 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 5/12] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:24 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1219 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:25.365122 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e954d047-f65f-431a-8d28-40c9e4434666 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:25.370904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e954d047-f65f-431a-8d28-40c9e4434666 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:25.512591 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:07:25.513694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:07:25.514955 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:07:25.515586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:07:25.516203 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:07:25.537437 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:25.538124 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:25.542246 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:25.542824 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:25.609585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Getting quotas for project 71c9cca288b34019947e55d2a3112ddb. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:07:25.616012 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Getting quotas for user a3be90df779b4ddb8639d825fcb41234 and project 71c9cca288b34019947e55d2a3112ddb. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:07:25.623245 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e954d047-f65f-431a-8d28-40c9e4434666 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:25.631710 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e954d047-f65f-431a-8d28-40c9e4434666 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1240 microversion: 2.1 time: 0.282655 Jun 23 20:07:25.632510 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:07:25.634932 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 6/13] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:25 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1240 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:25.636675 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:07:25.643993 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-66c5365e-0612-429f-8cbd-711390b2cb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:25.646393 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-66c5365e-0612-429f-8cbd-711390b2cb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:25.659945 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-66c5365e-0612-429f-8cbd-711390b2cb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:25.661277 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-66c5365e-0612-429f-8cbd-711390b2cb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:25.668884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-66c5365e-0612-429f-8cbd-711390b2cb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:25.670054 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-66c5365e-0612-429f-8cbd-711390b2cb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:25.784766 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-66c5365e-0612-429f-8cbd-711390b2cb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:25.800572 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-66c5365e-0612-429f-8cbd-711390b2cb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1218 microversion: 2.1 time: 0.164541 Jun 23 20:07:25.801656 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 7/14] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:25 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:25.813166 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-79582bdd-1704-4b79-8efb-919749c27ac1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.611866 Jun 23 20:07:25.814211 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 8/15] 10.222.0.44 () {62 vars in 1187 bytes} [Thu Jun 23 20:07:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 23 20:07:25.826789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1c191f0b-006d-4d55-9edd-16a470b988e0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:25.832573 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1c191f0b-006d-4d55-9edd-16a470b988e0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:25.893088 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1c191f0b-006d-4d55-9edd-16a470b988e0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:25.901713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1c191f0b-006d-4d55-9edd-16a470b988e0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:25.903632 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1c191f0b-006d-4d55-9edd-16a470b988e0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:25.905032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1c191f0b-006d-4d55-9edd-16a470b988e0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1281 microversion: 2.20 time: 0.083365 Jun 23 20:07:25.906060 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 8/16] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:25 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:26.364573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-07262002-3a00-415d-acb2-715afb51e867 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:26.371010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-07262002-3a00-415d-acb2-715afb51e867 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:26.392312 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07262002-3a00-415d-acb2-715afb51e867 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:26.392828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07262002-3a00-415d-acb2-715afb51e867 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:26.393719 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07262002-3a00-415d-acb2-715afb51e867 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:26.394160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07262002-3a00-415d-acb2-715afb51e867 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:26.652690 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-388e258e-4dba-4f80-936f-c27ae20d9352 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:26.654365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-388e258e-4dba-4f80-936f-c27ae20d9352 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:26.675988 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-388e258e-4dba-4f80-936f-c27ae20d9352 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:26.677873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-388e258e-4dba-4f80-936f-c27ae20d9352 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:26.678674 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-388e258e-4dba-4f80-936f-c27ae20d9352 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:26.681407 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-388e258e-4dba-4f80-936f-c27ae20d9352 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:26.848405 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-07262002-3a00-415d-acb2-715afb51e867 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:26.872493 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-07262002-3a00-415d-acb2-715afb51e867 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1267 microversion: 2.1 time: 0.507817 Jun 23 20:07:26.873661 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 9/17] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:26 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1267 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:26.879293 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a6e21188-0ad7-42af-b14b-b1eed7adffcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:26.880159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a6e21188-0ad7-42af-b14b-b1eed7adffcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:26.889004 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a6e21188-0ad7-42af-b14b-b1eed7adffcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:26.889643 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a6e21188-0ad7-42af-b14b-b1eed7adffcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:26.890755 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a6e21188-0ad7-42af-b14b-b1eed7adffcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:26.891461 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a6e21188-0ad7-42af-b14b-b1eed7adffcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:27.097643 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-388e258e-4dba-4f80-936f-c27ae20d9352 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:27.118863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-388e258e-4dba-4f80-936f-c27ae20d9352 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1244 microversion: 2.1 time: 0.470564 Jun 23 20:07:27.123149 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 9/18] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:26 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1244 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:27.140431 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a223e11a-5926-42ba-b939-bb76b9ae9720 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:27.145675 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a223e11a-5926-42ba-b939-bb76b9ae9720 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:27.213531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a6e21188-0ad7-42af-b14b-b1eed7adffcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:27.224559 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a6e21188-0ad7-42af-b14b-b1eed7adffcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1282 microversion: 2.1 time: 0.349380 Jun 23 20:07:27.264462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 10/19] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:26 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1282 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:27.548724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a223e11a-5926-42ba-b939-bb76b9ae9720 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:27.569417 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a223e11a-5926-42ba-b939-bb76b9ae9720 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:27.575610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a223e11a-5926-42ba-b939-bb76b9ae9720 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:27.588129 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a223e11a-5926-42ba-b939-bb76b9ae9720 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1281 microversion: 2.20 time: 0.459138 Jun 23 20:07:27.591309 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 10/20] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:27 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1281 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:27.890979 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-215597e3-27b0-497c-881d-6dd934ffdda5 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:27.892177 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-215597e3-27b0-497c-881d-6dd934ffdda5 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:27.907282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-215597e3-27b0-497c-881d-6dd934ffdda5 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:27.907738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-215597e3-27b0-497c-881d-6dd934ffdda5 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:27.908581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-215597e3-27b0-497c-881d-6dd934ffdda5 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:27.909094 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-215597e3-27b0-497c-881d-6dd934ffdda5 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:28.138780 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-899e1d34-f219-445c-b35b-b5b164b36efb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:28.139402 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-899e1d34-f219-445c-b35b-b5b164b36efb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:28.153985 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-899e1d34-f219-445c-b35b-b5b164b36efb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:28.153985 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-899e1d34-f219-445c-b35b-b5b164b36efb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:28.153985 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-899e1d34-f219-445c-b35b-b5b164b36efb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:28.153985 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-899e1d34-f219-445c-b35b-b5b164b36efb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:28.524678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-215597e3-27b0-497c-881d-6dd934ffdda5 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:28.524861 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-899e1d34-f219-445c-b35b-b5b164b36efb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:28.535608 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-215597e3-27b0-497c-881d-6dd934ffdda5 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1285 microversion: 2.1 time: 0.648364 Jun 23 20:07:28.536319 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 11/21] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:27 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1285 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:28.541337 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-643e9554-912d-4efa-a50e-9463767fa153 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:28.548223 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-643e9554-912d-4efa-a50e-9463767fa153 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:28.562504 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-899e1d34-f219-445c-b35b-b5b164b36efb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1292 microversion: 2.1 time: 0.413521 Jun 23 20:07:28.571397 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 11/22] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:28 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1292 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:28.593957 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-643e9554-912d-4efa-a50e-9463767fa153 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:28.594951 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-643e9554-912d-4efa-a50e-9463767fa153 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:28.598097 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-643e9554-912d-4efa-a50e-9463767fa153 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:28.599718 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-643e9554-912d-4efa-a50e-9463767fa153 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:28.615558 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:28.616272 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:28.628381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:28.629035 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:28.630197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:28.631032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:28.958991 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-643e9554-912d-4efa-a50e-9463767fa153 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:28.970711 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-643e9554-912d-4efa-a50e-9463767fa153 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1280 microversion: 2.1 time: 0.432831 Jun 23 20:07:28.988046 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 12/23] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:28 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1280 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:29.008119 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:29.068413 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:29.085582 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:29.087045 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a44861bd-6db3-4176-9b32-2afb41834873 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1333 microversion: 2.20 time: 0.482668 Jun 23 20:07:29.088055 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 12/24] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:28 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1333 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:07:29.557388 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e1c01d7a-54ed-434b-989d-4fd9636033f8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:29.558013 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e1c01d7a-54ed-434b-989d-4fd9636033f8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:29.581321 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e1c01d7a-54ed-434b-989d-4fd9636033f8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:29.589605 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4d17ff8d-1692-4466-b8ff-859b874b55cf tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:29.590908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4d17ff8d-1692-4466-b8ff-859b874b55cf tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:29.602167 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e1c01d7a-54ed-434b-989d-4fd9636033f8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:29.603119 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e1c01d7a-54ed-434b-989d-4fd9636033f8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:29.603614 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e1c01d7a-54ed-434b-989d-4fd9636033f8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:29.612405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4d17ff8d-1692-4466-b8ff-859b874b55cf tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:29.615967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4d17ff8d-1692-4466-b8ff-859b874b55cf tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:29.615967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4d17ff8d-1692-4466-b8ff-859b874b55cf tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:29.615967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4d17ff8d-1692-4466-b8ff-859b874b55cf tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:29.868091 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e1c01d7a-54ed-434b-989d-4fd9636033f8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:29.879542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e1c01d7a-54ed-434b-989d-4fd9636033f8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1273 microversion: 2.1 time: 0.326401 Jun 23 20:07:29.884511 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:29 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:29.898679 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4d17ff8d-1692-4466-b8ff-859b874b55cf tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:29.912172 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4d17ff8d-1692-4466-b8ff-859b874b55cf tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1310 microversion: 2.1 time: 0.327523 Jun 23 20:07:29.926234 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 13/26] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:29 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1310 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:29.995746 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dce86130-9460-447f-adff-eb511e7dfb0f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:29.997017 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dce86130-9460-447f-adff-eb511e7dfb0f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:30.012946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dce86130-9460-447f-adff-eb511e7dfb0f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:30.014114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dce86130-9460-447f-adff-eb511e7dfb0f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:30.021129 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dce86130-9460-447f-adff-eb511e7dfb0f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:30.021906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dce86130-9460-447f-adff-eb511e7dfb0f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:30.109140 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:30.109784 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:30.119817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:30.120278 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:30.125356 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:30.129023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:30.949151 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:30.973441 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:30.975509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:30.976926 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-61df0b1e-f33d-4920-998d-2d2f815e5f98 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1351 microversion: 2.20 time: 0.871869 Jun 23 20:07:30.989106 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 14/27] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:30 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1351 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:30.994425 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4cf3d7de-13a2-4e98-beca-7b7073de91bc tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:30.995332 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4cf3d7de-13a2-4e98-beca-7b7073de91bc tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:31.011240 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4cf3d7de-13a2-4e98-beca-7b7073de91bc tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:31.012126 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4cf3d7de-13a2-4e98-beca-7b7073de91bc tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:31.013251 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4cf3d7de-13a2-4e98-beca-7b7073de91bc tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:31.013926 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4cf3d7de-13a2-4e98-beca-7b7073de91bc tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:31.302768 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4cf3d7de-13a2-4e98-beca-7b7073de91bc tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:31.318092 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4cf3d7de-13a2-4e98-beca-7b7073de91bc tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1273 microversion: 2.1 time: 0.323891 Jun 23 20:07:31.331628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 15/28] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:30 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:31.342033 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dce86130-9460-447f-adff-eb511e7dfb0f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:31.365687 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dce86130-9460-447f-adff-eb511e7dfb0f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 1.365291 Jun 23 20:07:31.365687 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 14/29] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:29 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:31.366073 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-eb6d6f2f-e588-47a3-ba11-01780d6f2b4b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:31.366073 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-eb6d6f2f-e588-47a3-ba11-01780d6f2b4b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:31.383138 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eb6d6f2f-e588-47a3-ba11-01780d6f2b4b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:31.384406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eb6d6f2f-e588-47a3-ba11-01780d6f2b4b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:31.385481 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eb6d6f2f-e588-47a3-ba11-01780d6f2b4b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:31.387054 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eb6d6f2f-e588-47a3-ba11-01780d6f2b4b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:31.702744 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-eb6d6f2f-e588-47a3-ba11-01780d6f2b4b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:31.734000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-eb6d6f2f-e588-47a3-ba11-01780d6f2b4b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1298 microversion: 2.1 time: 0.400009 Jun 23 20:07:31.734596 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 16/30] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:31 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1298 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:32.010833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:32.011585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:32.021842 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:32.028093 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:32.028093 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:32.028093 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:32.357259 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fb19553d-1b7e-4186-8bae-7f71be8e698d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:32.359266 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fb19553d-1b7e-4186-8bae-7f71be8e698d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:32.386828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb19553d-1b7e-4186-8bae-7f71be8e698d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:32.394387 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb19553d-1b7e-4186-8bae-7f71be8e698d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:32.399273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb19553d-1b7e-4186-8bae-7f71be8e698d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:32.404835 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb19553d-1b7e-4186-8bae-7f71be8e698d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:32.440867 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:32.454527 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:32.469466 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:32.473573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f1d609ac-018b-4acf-89e4-73be6ccc864b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1339 microversion: 2.20 time: 0.475566 Jun 23 20:07:32.479864 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 15/31] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:31 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1339 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:32.489316 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1531f299-7831-4080-b2aa-57f9cfc227bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:32.490379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1531f299-7831-4080-b2aa-57f9cfc227bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:32.508732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1531f299-7831-4080-b2aa-57f9cfc227bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:32.509182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1531f299-7831-4080-b2aa-57f9cfc227bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:32.509963 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1531f299-7831-4080-b2aa-57f9cfc227bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:32.514205 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1531f299-7831-4080-b2aa-57f9cfc227bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:33.269723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fb19553d-1b7e-4186-8bae-7f71be8e698d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:33.278260 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fb19553d-1b7e-4186-8bae-7f71be8e698d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.946218 Jun 23 20:07:33.283272 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 17/32] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:32 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:33.298215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e7e34072-afdc-44bc-8a87-137b3646d9f3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:33.300218 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e7e34072-afdc-44bc-8a87-137b3646d9f3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:33.308469 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e7e34072-afdc-44bc-8a87-137b3646d9f3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:33.316491 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e7e34072-afdc-44bc-8a87-137b3646d9f3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:33.326221 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e7e34072-afdc-44bc-8a87-137b3646d9f3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:33.327296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e7e34072-afdc-44bc-8a87-137b3646d9f3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:33.553725 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e7e34072-afdc-44bc-8a87-137b3646d9f3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:33.573484 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e7e34072-afdc-44bc-8a87-137b3646d9f3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1298 microversion: 2.1 time: 0.285882 Jun 23 20:07:33.574260 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 18/33] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:33 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1298 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:33.706872 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-6dd359c9-e7f8-4908-bc1d-63d48680c933 req-3fee5f9b-427a-4b05-8fda-6708d7fec1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987900b9-9acf-4c20-a35e-edafdeb4454f", "tag": "0b459b45-118e-4c32-8dbf-c6257947db62"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:33.725748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-6dd359c9-e7f8-4908-bc1d-63d48680c933 req-3fee5f9b-427a-4b05-8fda-6708d7fec1c6 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:33.725748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-6dd359c9-e7f8-4908-bc1d-63d48680c933 req-3fee5f9b-427a-4b05-8fda-6708d7fec1c6 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:33.766894 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-6dd359c9-e7f8-4908-bc1d-63d48680c933 req-3fee5f9b-427a-4b05-8fda-6708d7fec1c6 service nova] Creating event network-changed:0b459b45-118e-4c32-8dbf-c6257947db62 for instance 987900b9-9acf-4c20-a35e-edafdeb4454f on hv-cinder-84727 Jun 23 20:07:33.767805 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-6dd359c9-e7f8-4908-bc1d-63d48680c933 req-3fee5f9b-427a-4b05-8fda-6708d7fec1c6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118346) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 20:07:33.769208 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-784a4e29-e55b-4243-b21d-c2078992986c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:33.770332 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-784a4e29-e55b-4243-b21d-c2078992986c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:33.772222 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-784a4e29-e55b-4243-b21d-c2078992986c None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:33.773189 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-784a4e29-e55b-4243-b21d-c2078992986c None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:33.788115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.compute.rpcapi [None req-784a4e29-e55b-4243-b21d-c2078992986c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 20:07:33.789426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-784a4e29-e55b-4243-b21d-c2078992986c None None] Releasing lock "compute-rpcapi-router" {{(pid=118346) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 20:07:33.831921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-784a4e29-e55b-4243-b21d-c2078992986c None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255723 Jun 23 20:07:33.833554 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 19/34] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:07:33.847477 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:33.848452 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:33.856655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:33.857797 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:33.859516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:33.860434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:34.236613 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1531f299-7831-4080-b2aa-57f9cfc227bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:34.246206 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1531f299-7831-4080-b2aa-57f9cfc227bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 1.764746 Jun 23 20:07:34.256922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 16/35] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:32 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:34.302004 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-98dc4a0e-20c7-42a2-9a22-2ccb232ceec7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:34.303328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-98dc4a0e-20c7-42a2-9a22-2ccb232ceec7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:34.322498 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-98dc4a0e-20c7-42a2-9a22-2ccb232ceec7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:34.325583 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-98dc4a0e-20c7-42a2-9a22-2ccb232ceec7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:34.326630 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-98dc4a0e-20c7-42a2-9a22-2ccb232ceec7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:34.333858 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-98dc4a0e-20c7-42a2-9a22-2ccb232ceec7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:34.597937 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:34.616714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:34.626212 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:34.628655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-95dea682-0311-438d-a913-f45b950d16e7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.793177 Jun 23 20:07:34.636425 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 20/36] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:33 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:34.644622 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c7300d3f-6f6f-4981-83d8-e5204f15be8d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:34.646178 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c7300d3f-6f6f-4981-83d8-e5204f15be8d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:34.668968 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c7300d3f-6f6f-4981-83d8-e5204f15be8d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:34.669639 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c7300d3f-6f6f-4981-83d8-e5204f15be8d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:34.671013 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c7300d3f-6f6f-4981-83d8-e5204f15be8d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:34.671730 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c7300d3f-6f6f-4981-83d8-e5204f15be8d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:34.855648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-98dc4a0e-20c7-42a2-9a22-2ccb232ceec7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:34.866020 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-98dc4a0e-20c7-42a2-9a22-2ccb232ceec7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.567795 Jun 23 20:07:34.867866 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 17/37] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:34 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:34.897834 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c7300d3f-6f6f-4981-83d8-e5204f15be8d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:34.905884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c7300d3f-6f6f-4981-83d8-e5204f15be8d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1298 microversion: 2.1 time: 0.274959 Jun 23 20:07:34.910197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 21/38] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:34 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1298 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:35.268809 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c31e9458-a621-43e1-bf7b-0b58dd24f204 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:35.269491 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c31e9458-a621-43e1-bf7b-0b58dd24f204 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:35.294037 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c31e9458-a621-43e1-bf7b-0b58dd24f204 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:35.294037 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c31e9458-a621-43e1-bf7b-0b58dd24f204 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:35.294037 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c31e9458-a621-43e1-bf7b-0b58dd24f204 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:35.306700 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c31e9458-a621-43e1-bf7b-0b58dd24f204 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:35.571211 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:35.628322 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=28 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:35.652759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:35.657531 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:35.673030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:35.693390 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:35.699674 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:35.701306 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:36.660919 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:36.684960 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:36.688614 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:36.691695 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e6a08614-2e41-4370-82a9-643287ec932b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 1.043135 Jun 23 20:07:36.704723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 22/39] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:35 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:36.710568 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-335470b9-2ef7-4eea-ad69-2a1cd8e76ba9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:36.713149 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-335470b9-2ef7-4eea-ad69-2a1cd8e76ba9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:36.719253 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-335470b9-2ef7-4eea-ad69-2a1cd8e76ba9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:36.719871 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-335470b9-2ef7-4eea-ad69-2a1cd8e76ba9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:36.720195 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c31e9458-a621-43e1-bf7b-0b58dd24f204 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:36.722327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-335470b9-2ef7-4eea-ad69-2a1cd8e76ba9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:36.723090 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-335470b9-2ef7-4eea-ad69-2a1cd8e76ba9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:36.748099 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c31e9458-a621-43e1-bf7b-0b58dd24f204 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 1.479388 Jun 23 20:07:36.762040 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 18/40] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:35 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:36.772220 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a142d622-6232-4a1f-ab2a-6096e5165ba1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:36.776575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a142d622-6232-4a1f-ab2a-6096e5165ba1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:36.797276 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a142d622-6232-4a1f-ab2a-6096e5165ba1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:36.797796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a142d622-6232-4a1f-ab2a-6096e5165ba1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:36.798659 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a142d622-6232-4a1f-ab2a-6096e5165ba1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:36.801949 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a142d622-6232-4a1f-ab2a-6096e5165ba1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:37.175877 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-335470b9-2ef7-4eea-ad69-2a1cd8e76ba9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:37.179569 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=100 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:37.183924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-335470b9-2ef7-4eea-ad69-2a1cd8e76ba9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.477726 Jun 23 20:07:37.193651 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 23/41] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:36 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:37.198757 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-fa97ee3b-956e-47b2-a38a-1a662c7ec2c7 req-e81861e3-3d2c-4c8c-aa11-4a8b67398c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a", "tag": "01e605d9-8bd3-4f1a-81cd-9ad85b78e81a"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:37.203800 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:37.208254 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-fa97ee3b-956e-47b2-a38a-1a662c7ec2c7 req-e81861e3-3d2c-4c8c-aa11-4a8b67398c9f service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:37.208934 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-fa97ee3b-956e-47b2-a38a-1a662c7ec2c7 req-e81861e3-3d2c-4c8c-aa11-4a8b67398c9f service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:37.221606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-fa97ee3b-956e-47b2-a38a-1a662c7ec2c7 req-e81861e3-3d2c-4c8c-aa11-4a8b67398c9f service nova] Creating event network-changed:01e605d9-8bd3-4f1a-81cd-9ad85b78e81a for instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a on hv-cinder-84727 Jun 23 20:07:37.226968 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-fa97ee3b-956e-47b2-a38a-1a662c7ec2c7 req-e81861e3-3d2c-4c8c-aa11-4a8b67398c9f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032057 Jun 23 20:07:37.228042 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 24/42] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:07:37.486580 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a142d622-6232-4a1f-ab2a-6096e5165ba1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:37.510277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a142d622-6232-4a1f-ab2a-6096e5165ba1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.753673 Jun 23 20:07:37.515298 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 19/43] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:36 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:37.707676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=26 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:37.713341 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:37.713977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:37.739179 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:37.751928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:37.753562 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:37.754241 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:37.774612 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e4245448-a7df-44ee-94c1-7af75e154a13 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:37.775353 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e4245448-a7df-44ee-94c1-7af75e154a13 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:37.814393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e4245448-a7df-44ee-94c1-7af75e154a13 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:37.815507 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e4245448-a7df-44ee-94c1-7af75e154a13 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:37.831541 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e4245448-a7df-44ee-94c1-7af75e154a13 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:37.832035 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e4245448-a7df-44ee-94c1-7af75e154a13 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:38.348686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e4245448-a7df-44ee-94c1-7af75e154a13 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:38.351476 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:38.357181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e4245448-a7df-44ee-94c1-7af75e154a13 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.591422 Jun 23 20:07:38.357762 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 20/44] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:37 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:38.372271 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:38.374111 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:38.374883 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-00a5ea80-526d-4486-8f17-71a03744b269 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.668666 Jun 23 20:07:38.375427 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 25/45] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:37 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:38.383273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-82a9e7b5-4fc4-4a56-ad62-98e9389dcbb8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:38.383870 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-82a9e7b5-4fc4-4a56-ad62-98e9389dcbb8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:38.390290 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82a9e7b5-4fc4-4a56-ad62-98e9389dcbb8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:38.390737 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82a9e7b5-4fc4-4a56-ad62-98e9389dcbb8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:38.391490 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82a9e7b5-4fc4-4a56-ad62-98e9389dcbb8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:38.391924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82a9e7b5-4fc4-4a56-ad62-98e9389dcbb8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:38.607554 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-82a9e7b5-4fc4-4a56-ad62-98e9389dcbb8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:38.616110 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-82a9e7b5-4fc4-4a56-ad62-98e9389dcbb8 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.239505 Jun 23 20:07:38.621723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 26/46] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:38 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:38.634733 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-982c95e5-6d6f-4794-8f31-37f1d1fb3677 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:38.635590 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-982c95e5-6d6f-4794-8f31-37f1d1fb3677 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:38.644330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-982c95e5-6d6f-4794-8f31-37f1d1fb3677 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:38.644788 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-982c95e5-6d6f-4794-8f31-37f1d1fb3677 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:38.645585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-982c95e5-6d6f-4794-8f31-37f1d1fb3677 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:38.646026 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-982c95e5-6d6f-4794-8f31-37f1d1fb3677 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:38.839443 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-982c95e5-6d6f-4794-8f31-37f1d1fb3677 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:38.843290 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-982c95e5-6d6f-4794-8f31-37f1d1fb3677 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.220503 Jun 23 20:07:38.843960 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 27/47] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:38 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:38.858793 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-06910fdc-4cda-4dc5-b9b4-3a13eb8fa3a1 req-c432a525-e55e-4d19-8907-5945f71956d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380622ce-1095-4eba-857e-8139ece728c2", "tag": "46644b54-9e8f-46fa-9bb2-1bb72492e903"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:38.867694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:38.871898 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-06910fdc-4cda-4dc5-b9b4-3a13eb8fa3a1 req-c432a525-e55e-4d19-8907-5945f71956d0 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:38.872362 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-06910fdc-4cda-4dc5-b9b4-3a13eb8fa3a1 req-c432a525-e55e-4d19-8907-5945f71956d0 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:38.895086 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-06910fdc-4cda-4dc5-b9b4-3a13eb8fa3a1 req-c432a525-e55e-4d19-8907-5945f71956d0 service nova] Creating event network-changed:46644b54-9e8f-46fa-9bb2-1bb72492e903 for instance 380622ce-1095-4eba-857e-8139ece728c2 on hv-cinder-84727 Jun 23 20:07:38.895913 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-06910fdc-4cda-4dc5-b9b4-3a13eb8fa3a1 req-c432a525-e55e-4d19-8907-5945f71956d0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118345) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 20:07:38.897035 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb814f65-9dd3-458f-89a7-f2e60c2eaf79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:38.897469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb814f65-9dd3-458f-89a7-f2e60c2eaf79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:38.898232 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb814f65-9dd3-458f-89a7-f2e60c2eaf79 None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:38.898658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb814f65-9dd3-458f-89a7-f2e60c2eaf79 None None] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:38.907638 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.compute.rpcapi [None req-cb814f65-9dd3-458f-89a7-f2e60c2eaf79 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 20:07:38.909226 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb814f65-9dd3-458f-89a7-f2e60c2eaf79 None None] Releasing lock "compute-rpcapi-router" {{(pid=118345) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 20:07:38.934418 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cb814f65-9dd3-458f-89a7-f2e60c2eaf79 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.575017 Jun 23 20:07:38.935561 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 21/48] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:07:39.377911 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4ead31ba-7bfc-4226-b212-1993f101745e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:39.379146 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4ead31ba-7bfc-4226-b212-1993f101745e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:39.386819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4ead31ba-7bfc-4226-b212-1993f101745e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:39.387650 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4ead31ba-7bfc-4226-b212-1993f101745e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:39.396293 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:39.397258 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:39.400474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4ead31ba-7bfc-4226-b212-1993f101745e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:39.406839 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4ead31ba-7bfc-4226-b212-1993f101745e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:39.408055 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:39.408568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:39.411484 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:39.411937 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:39.674413 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:39.683518 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4ead31ba-7bfc-4226-b212-1993f101745e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:39.685570 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:39.687134 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:39.688193 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9bae3309-3806-4150-8bd7-28a8db2cef3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.298396 Jun 23 20:07:39.688781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 22/49] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:39 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:07:39.693599 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4ead31ba-7bfc-4226-b212-1993f101745e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.322304 Jun 23 20:07:39.703566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be61ab0c-0fd2-466e-83e9-51a5134df446 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:39.703975 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 28/50] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:39 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:39.704181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be61ab0c-0fd2-466e-83e9-51a5134df446 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:39.704181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be61ab0c-0fd2-466e-83e9-51a5134df446 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:39.704181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be61ab0c-0fd2-466e-83e9-51a5134df446 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:39.704181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be61ab0c-0fd2-466e-83e9-51a5134df446 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:39.704451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be61ab0c-0fd2-466e-83e9-51a5134df446 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:39.835831 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be61ab0c-0fd2-466e-83e9-51a5134df446 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:39.844092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be61ab0c-0fd2-466e-83e9-51a5134df446 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.154023 Jun 23 20:07:39.844593 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 23/51] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:39 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:39.862767 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-82ef44c2-f6ee-44ef-9d9a-c9e822b49e12 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:39.863435 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-82ef44c2-f6ee-44ef-9d9a-c9e822b49e12 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:39.869768 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82ef44c2-f6ee-44ef-9d9a-c9e822b49e12 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:39.870215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82ef44c2-f6ee-44ef-9d9a-c9e822b49e12 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:39.870990 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82ef44c2-f6ee-44ef-9d9a-c9e822b49e12 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:39.871382 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82ef44c2-f6ee-44ef-9d9a-c9e822b49e12 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:40.009028 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-82ef44c2-f6ee-44ef-9d9a-c9e822b49e12 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:40.014283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-82ef44c2-f6ee-44ef-9d9a-c9e822b49e12 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.155913 Jun 23 20:07:40.014854 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 29/52] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:39 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:40.712902 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-45476de6-1c00-4f93-8649-f5a17652168e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:40.713490 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:40.713943 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-45476de6-1c00-4f93-8649-f5a17652168e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:40.714274 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:40.719490 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45476de6-1c00-4f93-8649-f5a17652168e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:40.719927 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45476de6-1c00-4f93-8649-f5a17652168e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:40.720274 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:40.721308 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45476de6-1c00-4f93-8649-f5a17652168e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:40.721413 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:40.721749 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45476de6-1c00-4f93-8649-f5a17652168e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:40.722133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:40.722570 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:41.168704 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:41.178191 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:41.184430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:41.197184 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-10d6e994-2cc9-4f19-81d1-a3ff53b05811 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.476757 Jun 23 20:07:41.197184 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 24/53] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:40 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:41.202725 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e988739a-03e1-4e1f-ab85-5b939ef0ce6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:41.203532 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e988739a-03e1-4e1f-ab85-5b939ef0ce6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:41.203731 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-45476de6-1c00-4f93-8649-f5a17652168e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:41.210544 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e988739a-03e1-4e1f-ab85-5b939ef0ce6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:41.211205 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e988739a-03e1-4e1f-ab85-5b939ef0ce6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:41.212136 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e988739a-03e1-4e1f-ab85-5b939ef0ce6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:41.212740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e988739a-03e1-4e1f-ab85-5b939ef0ce6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:41.230132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-45476de6-1c00-4f93-8649-f5a17652168e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.520762 Jun 23 20:07:41.239985 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 30/54] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:40 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:41.247618 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:41.250931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-accd2fb2-39d6-4df8-9249-0f658b018086 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:41.251543 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-accd2fb2-39d6-4df8-9249-0f658b018086 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:41.282505 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-accd2fb2-39d6-4df8-9249-0f658b018086 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:41.285527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-accd2fb2-39d6-4df8-9249-0f658b018086 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:41.285527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-accd2fb2-39d6-4df8-9249-0f658b018086 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:41.285527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-accd2fb2-39d6-4df8-9249-0f658b018086 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:41.508887 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e988739a-03e1-4e1f-ab85-5b939ef0ce6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:41.516559 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e988739a-03e1-4e1f-ab85-5b939ef0ce6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.318013 Jun 23 20:07:41.522719 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 25/55] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:41 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:41.535884 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-5d075cb9-85e6-4c1e-8d9f-e432a2c5a135 req-957c8345-fbf9-42cd-8468-dc235174c3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade71e5a-f39d-4c61-8364-fd629f524922", "tag": "8086e419-b878-452b-9a11-4f1f68390daf"}, {"name": "network-changed", "server_uuid": "c507d545-f924-49b1-91db-92efe489eed7", "tag": "e2d0d115-8902-4843-bd9b-e0319ca9a623"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:41.545958 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-5d075cb9-85e6-4c1e-8d9f-e432a2c5a135 req-957c8345-fbf9-42cd-8468-dc235174c3e2 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:41.546569 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-5d075cb9-85e6-4c1e-8d9f-e432a2c5a135 req-957c8345-fbf9-42cd-8468-dc235174c3e2 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:41.561076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-accd2fb2-39d6-4df8-9249-0f658b018086 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:41.576064 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-accd2fb2-39d6-4df8-9249-0f658b018086 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.335374 Jun 23 20:07:41.576677 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 31/56] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:41 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:41.581366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-5d075cb9-85e6-4c1e-8d9f-e432a2c5a135 req-957c8345-fbf9-42cd-8468-dc235174c3e2 service nova] Creating event network-changed:8086e419-b878-452b-9a11-4f1f68390daf for instance ade71e5a-f39d-4c61-8364-fd629f524922 on hv-cinder-84727 Jun 23 20:07:41.582086 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-5d075cb9-85e6-4c1e-8d9f-e432a2c5a135 req-957c8345-fbf9-42cd-8468-dc235174c3e2 service nova] Creating event network-changed:e2d0d115-8902-4843-bd9b-e0319ca9a623 for instance c507d545-f924-49b1-91db-92efe489eed7 on hv-cinder-84727 Jun 23 20:07:41.589119 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-5d075cb9-85e6-4c1e-8d9f-e432a2c5a135 req-957c8345-fbf9-42cd-8468-dc235174c3e2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065017 Jun 23 20:07:41.589722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 26/57] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:07:42.204865 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:42.205905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:42.218102 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:42.224715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:42.224715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:42.224715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:42.249502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f287d3b6-bbed-4796-af40-97a14e8d869e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:42.254409 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f287d3b6-bbed-4796-af40-97a14e8d869e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:42.274544 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f287d3b6-bbed-4796-af40-97a14e8d869e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:42.275003 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f287d3b6-bbed-4796-af40-97a14e8d869e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:42.275760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f287d3b6-bbed-4796-af40-97a14e8d869e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:42.276667 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f287d3b6-bbed-4796-af40-97a14e8d869e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:42.429132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:42.438152 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:42.443136 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:42.443136 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-afcb0b3b-24e8-4444-b28d-62eb1da61e92 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.240691 Jun 23 20:07:42.443136 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 32/58] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:42 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:42.456208 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f287d3b6-bbed-4796-af40-97a14e8d869e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:42.464096 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f287d3b6-bbed-4796-af40-97a14e8d869e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.219779 Jun 23 20:07:42.464761 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 27/59] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:42 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:42.536155 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-27f6bfd9-fabf-4d70-9ca5-5ad075b10e0c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:42.539048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-27f6bfd9-fabf-4d70-9ca5-5ad075b10e0c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:42.543622 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-27f6bfd9-fabf-4d70-9ca5-5ad075b10e0c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:42.544109 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-27f6bfd9-fabf-4d70-9ca5-5ad075b10e0c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:42.544891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-27f6bfd9-fabf-4d70-9ca5-5ad075b10e0c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:42.545319 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-27f6bfd9-fabf-4d70-9ca5-5ad075b10e0c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:42.597894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-95050c88-5243-4b36-91f5-4b40d4ead1ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:42.598611 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-95050c88-5243-4b36-91f5-4b40d4ead1ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:42.604845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95050c88-5243-4b36-91f5-4b40d4ead1ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:42.605714 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95050c88-5243-4b36-91f5-4b40d4ead1ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:42.606498 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95050c88-5243-4b36-91f5-4b40d4ead1ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:42.606931 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95050c88-5243-4b36-91f5-4b40d4ead1ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:42.745185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-27f6bfd9-fabf-4d70-9ca5-5ad075b10e0c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:42.754193 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-27f6bfd9-fabf-4d70-9ca5-5ad075b10e0c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.222762 Jun 23 20:07:42.754720 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 33/60] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:42 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:42.803836 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-95050c88-5243-4b36-91f5-4b40d4ead1ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:42.813457 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-95050c88-5243-4b36-91f5-4b40d4ead1ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.220569 Jun 23 20:07:42.817297 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 28/61] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:42 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:43.459770 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:43.460593 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:43.466903 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:43.467500 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:43.468262 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:43.468717 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:43.482138 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5707006d-5a57-4f78-aae0-9de88ff83bae tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:43.483369 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5707006d-5a57-4f78-aae0-9de88ff83bae tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:43.490756 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5707006d-5a57-4f78-aae0-9de88ff83bae tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:43.491542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5707006d-5a57-4f78-aae0-9de88ff83bae tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:43.493182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5707006d-5a57-4f78-aae0-9de88ff83bae tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:43.494036 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5707006d-5a57-4f78-aae0-9de88ff83bae tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:43.691618 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5707006d-5a57-4f78-aae0-9de88ff83bae tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:43.699656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5707006d-5a57-4f78-aae0-9de88ff83bae tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.221833 Jun 23 20:07:43.700801 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 29/62] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:43 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:43.708862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:43.724409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:43.724409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:43.724409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e83f4db8-5000-4c79-925a-4f5227031f60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.267751 Jun 23 20:07:43.724681 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 34/63] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:43 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:43.774551 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-83445d32-343e-4757-9f85-93c39a089225 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:43.775302 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-83445d32-343e-4757-9f85-93c39a089225 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:43.781346 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-83445d32-343e-4757-9f85-93c39a089225 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:43.781802 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-83445d32-343e-4757-9f85-93c39a089225 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:43.782562 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-83445d32-343e-4757-9f85-93c39a089225 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:43.783526 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-83445d32-343e-4757-9f85-93c39a089225 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:43.831024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e726ee42-3b5a-4520-9e78-daba3bc5d53f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:43.831896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e726ee42-3b5a-4520-9e78-daba3bc5d53f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:43.834432 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=8 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:43.844134 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e726ee42-3b5a-4520-9e78-daba3bc5d53f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:43.844134 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e726ee42-3b5a-4520-9e78-daba3bc5d53f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:43.844134 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e726ee42-3b5a-4520-9e78-daba3bc5d53f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:43.844134 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e726ee42-3b5a-4520-9e78-daba3bc5d53f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:43.994790 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-83445d32-343e-4757-9f85-93c39a089225 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:44.003195 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-83445d32-343e-4757-9f85-93c39a089225 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.233302 Jun 23 20:07:44.003769 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 30/64] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:43 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:44.019538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e726ee42-3b5a-4520-9e78-daba3bc5d53f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:44.027488 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e726ee42-3b5a-4520-9e78-daba3bc5d53f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.200291 Jun 23 20:07:44.028196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 35/65] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:43 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:44.715947 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7b2c7010-e2ae-4b7b-8c52-bcca683ffe47 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:44.716561 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7b2c7010-e2ae-4b7b-8c52-bcca683ffe47 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:44.723010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b2c7010-e2ae-4b7b-8c52-bcca683ffe47 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:44.725135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b2c7010-e2ae-4b7b-8c52-bcca683ffe47 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:44.725135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b2c7010-e2ae-4b7b-8c52-bcca683ffe47 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:44.725135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b2c7010-e2ae-4b7b-8c52-bcca683ffe47 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:44.741962 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:44.743084 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:44.748719 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:44.749162 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:44.749912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:44.750345 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:44.916800 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7b2c7010-e2ae-4b7b-8c52-bcca683ffe47 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:44.924216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:44.924784 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7b2c7010-e2ae-4b7b-8c52-bcca683ffe47 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.212701 Jun 23 20:07:44.925408 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 31/66] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:44 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:44.933308 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:44.934826 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:44.935946 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7af849c0-0fcb-4519-9bb5-759760139af9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.198223 Jun 23 20:07:44.936550 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 36/67] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:44 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:45.019842 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-073f0dac-8c7b-455c-ad28-38dc72279104 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:45.020389 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-073f0dac-8c7b-455c-ad28-38dc72279104 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:45.026420 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-073f0dac-8c7b-455c-ad28-38dc72279104 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:45.026864 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-073f0dac-8c7b-455c-ad28-38dc72279104 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:45.027598 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-073f0dac-8c7b-455c-ad28-38dc72279104 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:45.028032 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-073f0dac-8c7b-455c-ad28-38dc72279104 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:45.045407 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-833b353b-66c1-4c82-9b03-69ab44b6666c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:45.046016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-833b353b-66c1-4c82-9b03-69ab44b6666c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:45.055201 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-833b353b-66c1-4c82-9b03-69ab44b6666c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:45.055680 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-833b353b-66c1-4c82-9b03-69ab44b6666c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:45.056533 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-833b353b-66c1-4c82-9b03-69ab44b6666c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:45.057081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-833b353b-66c1-4c82-9b03-69ab44b6666c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:45.210921 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-073f0dac-8c7b-455c-ad28-38dc72279104 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:45.224158 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-073f0dac-8c7b-455c-ad28-38dc72279104 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.203858 Jun 23 20:07:45.238354 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 32/68] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:45 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:45.238706 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-833b353b-66c1-4c82-9b03-69ab44b6666c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:45.250719 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-833b353b-66c1-4c82-9b03-69ab44b6666c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.209305 Jun 23 20:07:45.256825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 37/69] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:45 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:45.947231 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8d619623-7b00-44b1-91c2-f4d5cef0b40c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:45.950162 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8d619623-7b00-44b1-91c2-f4d5cef0b40c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:45.957491 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d619623-7b00-44b1-91c2-f4d5cef0b40c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:45.958139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d619623-7b00-44b1-91c2-f4d5cef0b40c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:45.959301 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d619623-7b00-44b1-91c2-f4d5cef0b40c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:45.959888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8d619623-7b00-44b1-91c2-f4d5cef0b40c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:45.963613 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:45.968086 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:45.973367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:45.973917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:45.974760 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:45.975323 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:46.184721 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8d619623-7b00-44b1-91c2-f4d5cef0b40c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:46.190400 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:46.193162 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8d619623-7b00-44b1-91c2-f4d5cef0b40c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.250312 Jun 23 20:07:46.200694 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:46.202706 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:46.202864 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 33/70] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:45 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:46.204818 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2bcf65ad-9b96-4579-bde9-98297335e1aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.247079 Jun 23 20:07:46.206363 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 38/71] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:45 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:46.245814 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-acea2ea2-c863-4977-9e63-70cc4ae25f9c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:46.246431 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-acea2ea2-c863-4977-9e63-70cc4ae25f9c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:46.253129 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acea2ea2-c863-4977-9e63-70cc4ae25f9c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:46.253583 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acea2ea2-c863-4977-9e63-70cc4ae25f9c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:46.254352 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acea2ea2-c863-4977-9e63-70cc4ae25f9c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:46.255092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acea2ea2-c863-4977-9e63-70cc4ae25f9c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:46.274862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ff099b3a-15e7-4415-ae95-9ff6bccfcc18 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:46.275469 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ff099b3a-15e7-4415-ae95-9ff6bccfcc18 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:46.282280 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff099b3a-15e7-4415-ae95-9ff6bccfcc18 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:46.282957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff099b3a-15e7-4415-ae95-9ff6bccfcc18 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:46.283908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff099b3a-15e7-4415-ae95-9ff6bccfcc18 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:46.284527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff099b3a-15e7-4415-ae95-9ff6bccfcc18 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:47.052922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-acea2ea2-c863-4977-9e63-70cc4ae25f9c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:47.057553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ff099b3a-15e7-4415-ae95-9ff6bccfcc18 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:47.066885 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ff099b3a-15e7-4415-ae95-9ff6bccfcc18 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.795981 Jun 23 20:07:47.070546 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 39/72] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:46 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:47.074166 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-acea2ea2-c863-4977-9e63-70cc4ae25f9c tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.830425 Jun 23 20:07:47.074820 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 34/73] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:46 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:47.217396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-676ec52e-d10b-4e74-862e-7b7915143b56 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:47.218006 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-676ec52e-d10b-4e74-862e-7b7915143b56 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:47.240708 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:47.241871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:47.245791 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-676ec52e-d10b-4e74-862e-7b7915143b56 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:47.245791 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-676ec52e-d10b-4e74-862e-7b7915143b56 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:47.248812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-676ec52e-d10b-4e74-862e-7b7915143b56 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:47.249311 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-676ec52e-d10b-4e74-862e-7b7915143b56 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:47.251145 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:47.251790 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:47.253510 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:47.254103 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:47.612965 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-676ec52e-d10b-4e74-862e-7b7915143b56 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:47.620763 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-676ec52e-d10b-4e74-862e-7b7915143b56 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.409636 Jun 23 20:07:47.621356 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 40/74] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:47 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:47.673099 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:47.681826 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:47.683553 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:47.684906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-76bbe420-9c0d-4cab-a9fc-d626d9c12481 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.459612 Jun 23 20:07:47.685625 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 35/75] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:47 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:07:48.088511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f6f459be-7bb5-441b-8c76-cd1623a853bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:48.089839 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f6f459be-7bb5-441b-8c76-cd1623a853bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:48.098757 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6c7e35ca-1e82-4d9a-895e-23aa7acf7f6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:48.100010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6c7e35ca-1e82-4d9a-895e-23aa7acf7f6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:48.115566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f6f459be-7bb5-441b-8c76-cd1623a853bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:48.116015 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f6f459be-7bb5-441b-8c76-cd1623a853bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:48.119479 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c7e35ca-1e82-4d9a-895e-23aa7acf7f6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:48.119622 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f6f459be-7bb5-441b-8c76-cd1623a853bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:48.119622 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f6f459be-7bb5-441b-8c76-cd1623a853bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:48.122006 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c7e35ca-1e82-4d9a-895e-23aa7acf7f6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:48.123738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c7e35ca-1e82-4d9a-895e-23aa7acf7f6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:48.124356 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c7e35ca-1e82-4d9a-895e-23aa7acf7f6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:48.161728 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=100 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:48.329819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6c7e35ca-1e82-4d9a-895e-23aa7acf7f6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:48.338322 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6c7e35ca-1e82-4d9a-895e-23aa7acf7f6e tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.245959 Jun 23 20:07:48.338884 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 36/76] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:48 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:48.358092 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f6f459be-7bb5-441b-8c76-cd1623a853bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:48.366049 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f6f459be-7bb5-441b-8c76-cd1623a853bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.282654 Jun 23 20:07:48.366609 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 41/77] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:48 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:48.638246 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-35cb4011-d154-4e49-a3e4-86446410e0c6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:48.638932 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-35cb4011-d154-4e49-a3e4-86446410e0c6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:48.650736 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-35cb4011-d154-4e49-a3e4-86446410e0c6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:48.650736 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-35cb4011-d154-4e49-a3e4-86446410e0c6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:48.650736 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-35cb4011-d154-4e49-a3e4-86446410e0c6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:48.650736 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-35cb4011-d154-4e49-a3e4-86446410e0c6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:48.704264 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:48.705158 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:48.711945 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:48.712577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:48.713372 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:48.714016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:48.824804 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-35cb4011-d154-4e49-a3e4-86446410e0c6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:48.833029 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-35cb4011-d154-4e49-a3e4-86446410e0c6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.198431 Jun 23 20:07:48.833595 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 37/78] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:48 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:48.877484 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:48.888524 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:48.891043 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:48.892971 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c69a685e-cf26-440d-aa5c-8491aaf6bb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.193452 Jun 23 20:07:48.893812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 42/79] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:48 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:49.355842 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7fd8dcf3-a9f7-44ca-a746-29d0ee7afcd6 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:49.356470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7fd8dcf3-a9f7-44ca-a746-29d0ee7afcd6 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:49.358646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:49.364908 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7fd8dcf3-a9f7-44ca-a746-29d0ee7afcd6 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:49.365621 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7fd8dcf3-a9f7-44ca-a746-29d0ee7afcd6 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:49.366868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7fd8dcf3-a9f7-44ca-a746-29d0ee7afcd6 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:49.367554 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7fd8dcf3-a9f7-44ca-a746-29d0ee7afcd6 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:49.385172 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-87824353-bd83-4e77-b80a-8023b98a93ee tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:49.386670 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-87824353-bd83-4e77-b80a-8023b98a93ee tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:49.394985 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-87824353-bd83-4e77-b80a-8023b98a93ee tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:49.395837 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-87824353-bd83-4e77-b80a-8023b98a93ee tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:49.396994 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-87824353-bd83-4e77-b80a-8023b98a93ee tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:49.405365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-87824353-bd83-4e77-b80a-8023b98a93ee tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:50.156279 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-87824353-bd83-4e77-b80a-8023b98a93ee tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:50.165136 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-87824353-bd83-4e77-b80a-8023b98a93ee tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.785866 Jun 23 20:07:50.165722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 43/80] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:49 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:50.177001 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7fd8dcf3-a9f7-44ca-a746-29d0ee7afcd6 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:50.184403 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7fd8dcf3-a9f7-44ca-a746-29d0ee7afcd6 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.832865 Jun 23 20:07:50.194127 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 38/81] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:49 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:50.199674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-592c980d-0094-4bc8-a0c5-fc38b4ff8c97 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:50.200567 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-592c980d-0094-4bc8-a0c5-fc38b4ff8c97 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:50.207369 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-592c980d-0094-4bc8-a0c5-fc38b4ff8c97 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:50.208120 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-592c980d-0094-4bc8-a0c5-fc38b4ff8c97 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:50.209452 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-592c980d-0094-4bc8-a0c5-fc38b4ff8c97 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:50.210106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-592c980d-0094-4bc8-a0c5-fc38b4ff8c97 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:50.405771 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-c9358d6b-5310-4cfd-85ac-b646cd834f99 req-b2257e95-f6e0-4aaa-9b8f-6c825defb76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987900b9-9acf-4c20-a35e-edafdeb4454f", "name": "network-vif-plugged", "status": "completed", "tag": "0b459b45-118e-4c32-8dbf-c6257947db62"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:50.414606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c9358d6b-5310-4cfd-85ac-b646cd834f99 req-b2257e95-f6e0-4aaa-9b8f-6c825defb76d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:50.415052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c9358d6b-5310-4cfd-85ac-b646cd834f99 req-b2257e95-f6e0-4aaa-9b8f-6c825defb76d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:50.427424 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-c9358d6b-5310-4cfd-85ac-b646cd834f99 req-b2257e95-f6e0-4aaa-9b8f-6c825defb76d service nova] Creating event network-vif-plugged:0b459b45-118e-4c32-8dbf-c6257947db62 for instance 987900b9-9acf-4c20-a35e-edafdeb4454f on hv-cinder-84727 Jun 23 20:07:50.435633 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-c9358d6b-5310-4cfd-85ac-b646cd834f99 req-b2257e95-f6e0-4aaa-9b8f-6c825defb76d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268223 Jun 23 20:07:50.436242 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 44/82] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:07:50.442232 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:50.442930 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:50.452474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:50.453005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:50.453849 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:50.454350 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:50.889710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-592c980d-0094-4bc8-a0c5-fc38b4ff8c97 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:50.899227 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-592c980d-0094-4bc8-a0c5-fc38b4ff8c97 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.703805 Jun 23 20:07:50.900668 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 39/83] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:50 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:51.103428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:51.116658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:51.119626 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:51.120964 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-25e7aab7-86de-4937-875a-7367f8d865ad tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.683368 Jun 23 20:07:51.122070 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 45/84] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:50 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:51.185156 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-38116065-92b2-4bc9-a35b-dca50ffeaa45 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:51.185777 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-38116065-92b2-4bc9-a35b-dca50ffeaa45 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:51.193344 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38116065-92b2-4bc9-a35b-dca50ffeaa45 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:51.193791 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38116065-92b2-4bc9-a35b-dca50ffeaa45 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:51.194849 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38116065-92b2-4bc9-a35b-dca50ffeaa45 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:51.195291 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-38116065-92b2-4bc9-a35b-dca50ffeaa45 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:51.202033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5db6560a-988a-4d57-8999-0706efd08c45 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:51.202748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5db6560a-988a-4d57-8999-0706efd08c45 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:51.210948 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5db6560a-988a-4d57-8999-0706efd08c45 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:51.212248 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5db6560a-988a-4d57-8999-0706efd08c45 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:51.213509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5db6560a-988a-4d57-8999-0706efd08c45 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:51.214005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5db6560a-988a-4d57-8999-0706efd08c45 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:51.776053 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5db6560a-988a-4d57-8999-0706efd08c45 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:51.800568 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5db6560a-988a-4d57-8999-0706efd08c45 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.602778 Jun 23 20:07:51.809703 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-38116065-92b2-4bc9-a35b-dca50ffeaa45 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:51.811980 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 46/85] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:51 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:51.823145 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-38116065-92b2-4bc9-a35b-dca50ffeaa45 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.642411 Jun 23 20:07:51.824431 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 40/86] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:51 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:51.915745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-76e7d831-8ce4-4b4c-a698-0a5612914be8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:51.916375 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-76e7d831-8ce4-4b4c-a698-0a5612914be8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:51.925764 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-76e7d831-8ce4-4b4c-a698-0a5612914be8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:51.928752 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-76e7d831-8ce4-4b4c-a698-0a5612914be8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:51.930831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-76e7d831-8ce4-4b4c-a698-0a5612914be8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:51.931437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-76e7d831-8ce4-4b4c-a698-0a5612914be8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:52.139999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:52.140644 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:52.154428 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:52.156123 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:52.157111 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:52.158218 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:52.432222 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-76e7d831-8ce4-4b4c-a698-0a5612914be8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:52.438468 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:52.449063 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-76e7d831-8ce4-4b4c-a698-0a5612914be8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.537810 Jun 23 20:07:52.458243 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 47/87] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:51 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:52.463536 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:52.465462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:52.466219 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cbab214a-d25a-4dfa-9e00-a9ef61d58ca8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.330905 Jun 23 20:07:52.466888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 41/88] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:52 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:07:52.476790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-c095ea26-98e9-4cca-9b3d-cd84b1d8a9e3 req-9d118cfe-d38a-43e1-a6ed-0303f1a3e4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a", "name": "network-vif-plugged", "status": "completed", "tag": "01e605d9-8bd3-4f1a-81cd-9ad85b78e81a"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:52.481824 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c095ea26-98e9-4cca-9b3d-cd84b1d8a9e3 req-9d118cfe-d38a-43e1-a6ed-0303f1a3e4df service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:52.482365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c095ea26-98e9-4cca-9b3d-cd84b1d8a9e3 req-9d118cfe-d38a-43e1-a6ed-0303f1a3e4df service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:52.495161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-c095ea26-98e9-4cca-9b3d-cd84b1d8a9e3 req-9d118cfe-d38a-43e1-a6ed-0303f1a3e4df service nova] Creating event network-vif-plugged:01e605d9-8bd3-4f1a-81cd-9ad85b78e81a for instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a on hv-cinder-84727 Jun 23 20:07:52.501460 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-c095ea26-98e9-4cca-9b3d-cd84b1d8a9e3 req-9d118cfe-d38a-43e1-a6ed-0303f1a3e4df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034718 Jun 23 20:07:52.502931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 48/89] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:07:52.842414 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-55e35735-125b-40e3-9cde-0c1bbda48b2b tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:52.842745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-07a8dea1-23cd-426c-ab1d-7cbc6dd1ab5c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:52.843505 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-07a8dea1-23cd-426c-ab1d-7cbc6dd1ab5c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:52.849187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-55e35735-125b-40e3-9cde-0c1bbda48b2b tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:52.853893 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-07a8dea1-23cd-426c-ab1d-7cbc6dd1ab5c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:52.854343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-07a8dea1-23cd-426c-ab1d-7cbc6dd1ab5c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:52.855105 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-07a8dea1-23cd-426c-ab1d-7cbc6dd1ab5c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:52.855536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-07a8dea1-23cd-426c-ab1d-7cbc6dd1ab5c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:52.880531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55e35735-125b-40e3-9cde-0c1bbda48b2b tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:52.880531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55e35735-125b-40e3-9cde-0c1bbda48b2b tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:52.880531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55e35735-125b-40e3-9cde-0c1bbda48b2b tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:52.882812 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55e35735-125b-40e3-9cde-0c1bbda48b2b tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:52.932046 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:53.297992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-55e35735-125b-40e3-9cde-0c1bbda48b2b tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:53.309896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-55e35735-125b-40e3-9cde-0c1bbda48b2b tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.491459 Jun 23 20:07:53.311280 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 42/90] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:52 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:53.344879 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-07a8dea1-23cd-426c-ab1d-7cbc6dd1ab5c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:53.354507 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-07a8dea1-23cd-426c-ab1d-7cbc6dd1ab5c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.516439 Jun 23 20:07:53.355028 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 49/91] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:52 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:53.466122 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-29e15dc4-2431-4222-a5e2-cb436283d806 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:53.466944 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-29e15dc4-2431-4222-a5e2-cb436283d806 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:53.476945 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29e15dc4-2431-4222-a5e2-cb436283d806 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:53.477742 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29e15dc4-2431-4222-a5e2-cb436283d806 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:53.478925 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29e15dc4-2431-4222-a5e2-cb436283d806 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:53.479545 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-29e15dc4-2431-4222-a5e2-cb436283d806 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:53.484430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:53.485080 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:53.502085 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:53.502570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:53.505139 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:53.508545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:53.809239 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:53.815983 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-29e15dc4-2431-4222-a5e2-cb436283d806 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:53.823238 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:53.823582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-29e15dc4-2431-4222-a5e2-cb436283d806 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1322 microversion: 2.1 time: 0.361519 Jun 23 20:07:53.826520 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:53.828174 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7e27219b-c7cc-4539-9955-29ccbe808d89 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.347747 Jun 23 20:07:53.838947 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 50/92] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:53 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:53.839284 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 43/93] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:53 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:54.335422 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1ca2ae20-a7e3-407f-9ff8-b55827ae5994 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:54.336074 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1ca2ae20-a7e3-407f-9ff8-b55827ae5994 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:54.344553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae20-a7e3-407f-9ff8-b55827ae5994 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:54.345745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae20-a7e3-407f-9ff8-b55827ae5994 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:54.346529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae20-a7e3-407f-9ff8-b55827ae5994 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:54.346963 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1ca2ae20-a7e3-407f-9ff8-b55827ae5994 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:54.372699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f1ea826b-4974-4559-bc9d-b0d899fd3bf9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:54.374587 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f1ea826b-4974-4559-bc9d-b0d899fd3bf9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:54.381609 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f1ea826b-4974-4559-bc9d-b0d899fd3bf9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:54.382341 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f1ea826b-4974-4559-bc9d-b0d899fd3bf9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:54.383290 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f1ea826b-4974-4559-bc9d-b0d899fd3bf9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:54.384218 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f1ea826b-4974-4559-bc9d-b0d899fd3bf9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:54.561038 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1ca2ae20-a7e3-407f-9ff8-b55827ae5994 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:54.569925 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1ca2ae20-a7e3-407f-9ff8-b55827ae5994 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.246130 Jun 23 20:07:54.570751 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 51/94] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:54 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:54.573916 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f1ea826b-4974-4559-bc9d-b0d899fd3bf9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:54.582178 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f1ea826b-4974-4559-bc9d-b0d899fd3bf9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.214067 Jun 23 20:07:54.582768 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 44/95] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:54 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:54.841605 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4091c7b6-f1ee-4e41-aa59-6b6080463de1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:54.842778 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4091c7b6-f1ee-4e41-aa59-6b6080463de1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:54.848702 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:54.849301 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:54.851033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4091c7b6-f1ee-4e41-aa59-6b6080463de1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:54.854318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4091c7b6-f1ee-4e41-aa59-6b6080463de1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:54.854318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4091c7b6-f1ee-4e41-aa59-6b6080463de1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:54.854318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4091c7b6-f1ee-4e41-aa59-6b6080463de1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:54.869342 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:54.869791 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:54.870697 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:54.871171 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:55.076467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4091c7b6-f1ee-4e41-aa59-6b6080463de1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:55.084325 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4091c7b6-f1ee-4e41-aa59-6b6080463de1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1516 microversion: 2.1 time: 0.246888 Jun 23 20:07:55.096938 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 52/96] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:54 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:55.097244 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:55.104003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8df285c9-a00b-489f-adbc-5589bf940084 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:55.105097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8df285c9-a00b-489f-adbc-5589bf940084 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:55.109394 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:55.111489 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:55.112360 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8df285c9-a00b-489f-adbc-5589bf940084 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:55.112927 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8df285c9-a00b-489f-adbc-5589bf940084 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:55.113726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8df285c9-a00b-489f-adbc-5589bf940084 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:55.114322 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8df285c9-a00b-489f-adbc-5589bf940084 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:55.120830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-715255e4-0093-42ca-8030-0bfaa144f050 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.268514 Jun 23 20:07:55.121523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 45/97] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:54 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:07:55.166140 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-45635d7e-2f96-4511-98e4-611a3e5f946a req-eea90d50-e3ae-41ed-ad54-e5ca76aba7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380622ce-1095-4eba-857e-8139ece728c2", "name": "network-vif-plugged", "status": "completed", "tag": "46644b54-9e8f-46fa-9bb2-1bb72492e903"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:55.178431 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-45635d7e-2f96-4511-98e4-611a3e5f946a req-eea90d50-e3ae-41ed-ad54-e5ca76aba7d8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:55.179390 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-45635d7e-2f96-4511-98e4-611a3e5f946a req-eea90d50-e3ae-41ed-ad54-e5ca76aba7d8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:55.179785 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-8df285c9-a00b-489f-adbc-5589bf940084 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lazy-loading 'flavor' on Instance uuid 987900b9-9acf-4c20-a35e-edafdeb4454f {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:07:55.204365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-45635d7e-2f96-4511-98e4-611a3e5f946a req-eea90d50-e3ae-41ed-ad54-e5ca76aba7d8 service nova] Creating event network-vif-plugged:46644b54-9e8f-46fa-9bb2-1bb72492e903 for instance 380622ce-1095-4eba-857e-8139ece728c2 on hv-cinder-84727 Jun 23 20:07:55.210668 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-45635d7e-2f96-4511-98e4-611a3e5f946a req-eea90d50-e3ae-41ed-ad54-e5ca76aba7d8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047563 Jun 23 20:07:55.211732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 46/98] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:07:55.503084 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8df285c9-a00b-489f-adbc-5589bf940084 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f/action" status: 200 len: 32 microversion: 2.1 time: 0.403409 Jun 23 20:07:55.503709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 53/99] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:07:55 2022] POST /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 20:07:55.513962 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e9cfe08f-5b1a-4810-89b8-dd0343e0b315 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:55.514898 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e9cfe08f-5b1a-4810-89b8-dd0343e0b315 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:55.522256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e9cfe08f-5b1a-4810-89b8-dd0343e0b315 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:55.522709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e9cfe08f-5b1a-4810-89b8-dd0343e0b315 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:55.523472 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e9cfe08f-5b1a-4810-89b8-dd0343e0b315 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:55.523904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e9cfe08f-5b1a-4810-89b8-dd0343e0b315 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:55.587806 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-002a4d9f-c92b-4e44-b378-52f88a179cd7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:55.588633 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-002a4d9f-c92b-4e44-b378-52f88a179cd7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:55.597023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-002a4d9f-c92b-4e44-b378-52f88a179cd7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:55.597473 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-002a4d9f-c92b-4e44-b378-52f88a179cd7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:55.598230 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-002a4d9f-c92b-4e44-b378-52f88a179cd7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:55.598662 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-002a4d9f-c92b-4e44-b378-52f88a179cd7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:55.818886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e9cfe08f-5b1a-4810-89b8-dd0343e0b315 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:55.834597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e9cfe08f-5b1a-4810-89b8-dd0343e0b315 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.324777 Jun 23 20:07:55.835200 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 47/100] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:55 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:55.836209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-002a4d9f-c92b-4e44-b378-52f88a179cd7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:55.847245 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-002a4d9f-c92b-4e44-b378-52f88a179cd7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.263505 Jun 23 20:07:55.848069 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 54/101] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:55 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:07:55.848443 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2c25656c-efab-4b65-a2bf-1664a9fa53b2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:55.850085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2c25656c-efab-4b65-a2bf-1664a9fa53b2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:55.869933 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c25656c-efab-4b65-a2bf-1664a9fa53b2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:55.869933 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c25656c-efab-4b65-a2bf-1664a9fa53b2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:55.869933 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c25656c-efab-4b65-a2bf-1664a9fa53b2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:55.869933 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c25656c-efab-4b65-a2bf-1664a9fa53b2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:56.125302 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2c25656c-efab-4b65-a2bf-1664a9fa53b2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:56.153632 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:56.153632 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:56.165678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2c25656c-efab-4b65-a2bf-1664a9fa53b2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.325927 Jun 23 20:07:56.167509 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 48/102] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:55 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:56.168586 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:56.169043 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:56.169819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:56.170250 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:56.393775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:56.401729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:56.403235 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:56.404353 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0f57ebda-d6af-472a-bdc0-b8edc0ce8735 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.268989 Jun 23 20:07:56.404922 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 55/103] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:56 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:56.851536 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a44d44da-9086-446f-98e5-e13c392e7825 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:56.852125 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a44d44da-9086-446f-98e5-e13c392e7825 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:56.858462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a44d44da-9086-446f-98e5-e13c392e7825 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:56.858907 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a44d44da-9086-446f-98e5-e13c392e7825 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:56.859662 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a44d44da-9086-446f-98e5-e13c392e7825 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:56.860262 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a44d44da-9086-446f-98e5-e13c392e7825 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:56.865729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e5a71e77-582d-492b-830e-f06e50d05f69 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:56.866448 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e5a71e77-582d-492b-830e-f06e50d05f69 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:56.873493 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e5a71e77-582d-492b-830e-f06e50d05f69 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:56.873949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e5a71e77-582d-492b-830e-f06e50d05f69 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:56.875084 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e5a71e77-582d-492b-830e-f06e50d05f69 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:56.875234 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e5a71e77-582d-492b-830e-f06e50d05f69 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:57.362392 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a44d44da-9086-446f-98e5-e13c392e7825 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:57.371317 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a44d44da-9086-446f-98e5-e13c392e7825 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.523623 Jun 23 20:07:57.382432 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 49/104] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:56 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:57.382432 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c71834cf-5c99-4a0a-892a-d6c60555a372 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:57.382432 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c71834cf-5c99-4a0a-892a-d6c60555a372 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:57.382729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e5a71e77-582d-492b-830e-f06e50d05f69 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:57.384028 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c71834cf-5c99-4a0a-892a-d6c60555a372 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:57.384514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c71834cf-5c99-4a0a-892a-d6c60555a372 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:57.385277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c71834cf-5c99-4a0a-892a-d6c60555a372 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:57.385703 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c71834cf-5c99-4a0a-892a-d6c60555a372 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:57.387552 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e5a71e77-582d-492b-830e-f06e50d05f69 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.526460 Jun 23 20:07:57.390411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 56/105] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:56 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:57.395403 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-3703eead-e622-477d-ade2-8bf79654071a req-d971614b-cdd3-480b-9b95-755254458cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade71e5a-f39d-4c61-8364-fd629f524922", "name": "network-vif-plugged", "status": "completed", "tag": "8086e419-b878-452b-9a11-4f1f68390daf"}, {"server_uuid": "c507d545-f924-49b1-91db-92efe489eed7", "name": "network-vif-plugged", "status": "completed", "tag": "e2d0d115-8902-4843-bd9b-e0319ca9a623"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:07:57.408201 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3703eead-e622-477d-ade2-8bf79654071a req-d971614b-cdd3-480b-9b95-755254458cc6 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:57.411517 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3703eead-e622-477d-ade2-8bf79654071a req-d971614b-cdd3-480b-9b95-755254458cc6 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:57.413584 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:07:57.422673 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-3703eead-e622-477d-ade2-8bf79654071a req-d971614b-cdd3-480b-9b95-755254458cc6 service nova] Creating event network-vif-plugged:8086e419-b878-452b-9a11-4f1f68390daf for instance ade71e5a-f39d-4c61-8364-fd629f524922 on hv-cinder-84727 Jun 23 20:07:57.423280 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-3703eead-e622-477d-ade2-8bf79654071a req-d971614b-cdd3-480b-9b95-755254458cc6 service nova] Creating event network-vif-plugged:e2d0d115-8902-4843-bd9b-e0319ca9a623 for instance c507d545-f924-49b1-91db-92efe489eed7 on hv-cinder-84727 Jun 23 20:07:57.430948 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-3703eead-e622-477d-ade2-8bf79654071a req-d971614b-cdd3-480b-9b95-755254458cc6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039036 Jun 23 20:07:57.431917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 57/106] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:07:57.438649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:57.439476 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:57.449792 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:57.450292 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:57.451180 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:57.451713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:57.696177 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c71834cf-5c99-4a0a-892a-d6c60555a372 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:57.705286 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c71834cf-5c99-4a0a-892a-d6c60555a372 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.331716 Jun 23 20:07:57.706886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 50/107] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:57 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:57.741877 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:57.751139 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:57.753140 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:57.754366 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-961396b6-3f9c-40c3-80e3-b141c8526677 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1406 microversion: 2.20 time: 0.321292 Jun 23 20:07:57.756144 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 58/108] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:57 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:58.389469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-af482332-1244-473b-b6c1-01b2174204e5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:58.390240 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-af482332-1244-473b-b6c1-01b2174204e5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:58.397038 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af482332-1244-473b-b6c1-01b2174204e5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:58.397581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af482332-1244-473b-b6c1-01b2174204e5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:58.398414 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af482332-1244-473b-b6c1-01b2174204e5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:58.399390 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-af482332-1244-473b-b6c1-01b2174204e5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:58.404957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9e4a0f03-a4e3-4d37-965c-c9bdc84bcf10 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:58.405614 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9e4a0f03-a4e3-4d37-965c-c9bdc84bcf10 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:58.412350 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9e4a0f03-a4e3-4d37-965c-c9bdc84bcf10 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:58.413030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9e4a0f03-a4e3-4d37-965c-c9bdc84bcf10 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:58.413973 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9e4a0f03-a4e3-4d37-965c-c9bdc84bcf10 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:58.414553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9e4a0f03-a4e3-4d37-965c-c9bdc84bcf10 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:58.608718 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-af482332-1244-473b-b6c1-01b2174204e5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:58.619624 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-af482332-1244-473b-b6c1-01b2174204e5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.234298 Jun 23 20:07:58.620875 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 51/109] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:58 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:58.640424 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9e4a0f03-a4e3-4d37-965c-c9bdc84bcf10 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:58.647990 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9e4a0f03-a4e3-4d37-965c-c9bdc84bcf10 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.247346 Jun 23 20:07:58.648714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 59/110] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:58 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:58.724640 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-26490018-1105-4363-9740-cf9dc94dbda0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:58.725254 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-26490018-1105-4363-9740-cf9dc94dbda0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:58.737117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26490018-1105-4363-9740-cf9dc94dbda0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:58.737585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26490018-1105-4363-9740-cf9dc94dbda0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:58.741377 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26490018-1105-4363-9740-cf9dc94dbda0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:58.741837 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26490018-1105-4363-9740-cf9dc94dbda0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:58.772615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:58.773595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:58.781972 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:58.786981 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:58.786981 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:58.788906 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:59.108363 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-26490018-1105-4363-9740-cf9dc94dbda0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:59.118640 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:59.119287 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-26490018-1105-4363-9740-cf9dc94dbda0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.399891 Jun 23 20:07:59.119949 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 52/111] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:58 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:07:59.127102 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:59.128603 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:07:59.130002 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e30135fd-45a1-461d-a715-2b5582a18a53 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1599 microversion: 2.20 time: 0.361460 Jun 23 20:07:59.130996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 60/112] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:07:58 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1599 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:07:59.152811 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-418b2dd6-6c62-49b0-ad3c-a5838ad7442e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:59.153658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-418b2dd6-6c62-49b0-ad3c-a5838ad7442e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:59.162463 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-418b2dd6-6c62-49b0-ad3c-a5838ad7442e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:59.163091 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-418b2dd6-6c62-49b0-ad3c-a5838ad7442e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:59.164062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-418b2dd6-6c62-49b0-ad3c-a5838ad7442e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:59.164712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-418b2dd6-6c62-49b0-ad3c-a5838ad7442e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:59.337890 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-418b2dd6-6c62-49b0-ad3c-a5838ad7442e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.188179 Jun 23 20:07:59.338374 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 53/113] 10.222.0.44 () {60 vars in 1315 bytes} [Thu Jun 23 20:07:59 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:07:59.639072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-83088463-08b3-40eb-b0fc-8f4ce7a7e5e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:59.639698 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-83088463-08b3-40eb-b0fc-8f4ce7a7e5e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:59.652833 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83088463-08b3-40eb-b0fc-8f4ce7a7e5e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:59.656155 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83088463-08b3-40eb-b0fc-8f4ce7a7e5e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:59.658192 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83088463-08b3-40eb-b0fc-8f4ce7a7e5e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:59.666345 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f540bbc9-3b26-4ef8-acac-e61dab7794a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:07:59.667887 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f540bbc9-3b26-4ef8-acac-e61dab7794a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:07:59.670459 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83088463-08b3-40eb-b0fc-8f4ce7a7e5e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:59.679741 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f540bbc9-3b26-4ef8-acac-e61dab7794a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:59.681365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f540bbc9-3b26-4ef8-acac-e61dab7794a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:07:59.682213 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f540bbc9-3b26-4ef8-acac-e61dab7794a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:07:59.682710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f540bbc9-3b26-4ef8-acac-e61dab7794a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:00.539240 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f540bbc9-3b26-4ef8-acac-e61dab7794a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:00.549458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f540bbc9-3b26-4ef8-acac-e61dab7794a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.887683 Jun 23 20:08:00.558818 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 54/114] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:59 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:00.575190 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4b405498-26dd-487c-8f29-78ccbc5b8fe7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:00.575721 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4b405498-26dd-487c-8f29-78ccbc5b8fe7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:00.590040 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b405498-26dd-487c-8f29-78ccbc5b8fe7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:00.590480 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b405498-26dd-487c-8f29-78ccbc5b8fe7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:00.591432 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b405498-26dd-487c-8f29-78ccbc5b8fe7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:00.592085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4b405498-26dd-487c-8f29-78ccbc5b8fe7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:00.675368 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-83088463-08b3-40eb-b0fc-8f4ce7a7e5e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:00.700427 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-83088463-08b3-40eb-b0fc-8f4ce7a7e5e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 1.066796 Jun 23 20:08:00.703021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 61/115] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:07:59 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:01.134174 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4b405498-26dd-487c-8f29-78ccbc5b8fe7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:01.144217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4b405498-26dd-487c-8f29-78ccbc5b8fe7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1365 microversion: 2.1 time: 0.584248 Jun 23 20:08:01.145570 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 55/116] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:00 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1365 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:01.566420 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6f51527d-9bf1-4140-9cdb-ff8814a532f7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:01.567341 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6f51527d-9bf1-4140-9cdb-ff8814a532f7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:01.578603 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6f51527d-9bf1-4140-9cdb-ff8814a532f7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:01.579059 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6f51527d-9bf1-4140-9cdb-ff8814a532f7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:01.580414 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6f51527d-9bf1-4140-9cdb-ff8814a532f7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:01.581319 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6f51527d-9bf1-4140-9cdb-ff8814a532f7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:01.725023 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bde36108-029c-44e9-b0ad-6b46fdd0a623 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:01.726120 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bde36108-029c-44e9-b0ad-6b46fdd0a623 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:01.733412 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bde36108-029c-44e9-b0ad-6b46fdd0a623 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:01.734193 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bde36108-029c-44e9-b0ad-6b46fdd0a623 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:01.742686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bde36108-029c-44e9-b0ad-6b46fdd0a623 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:01.743345 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bde36108-029c-44e9-b0ad-6b46fdd0a623 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:01.844352 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-6f51527d-9bf1-4140-9cdb-ff8814a532f7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:01.853511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6f51527d-9bf1-4140-9cdb-ff8814a532f7 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1315 microversion: 2.1 time: 0.290662 Jun 23 20:08:01.854616 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 62/117] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:01 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:01.913000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-8f68ca71-e72d-4aaf-b636-e2916d23fc79 req-f0755972-357b-464d-af52-7ae09a53fc6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a", "tag": "01e605d9-8bd3-4f1a-81cd-9ad85b78e81a"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:01.926400 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-8f68ca71-e72d-4aaf-b636-e2916d23fc79 req-f0755972-357b-464d-af52-7ae09a53fc6a service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:01.926400 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-8f68ca71-e72d-4aaf-b636-e2916d23fc79 req-f0755972-357b-464d-af52-7ae09a53fc6a service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:01.941976 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-8f68ca71-e72d-4aaf-b636-e2916d23fc79 req-f0755972-357b-464d-af52-7ae09a53fc6a service nova] Creating event network-changed:01e605d9-8bd3-4f1a-81cd-9ad85b78e81a for instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a on hv-cinder-84727 Jun 23 20:08:01.947874 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-8f68ca71-e72d-4aaf-b636-e2916d23fc79 req-f0755972-357b-464d-af52-7ae09a53fc6a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040120 Jun 23 20:08:01.949012 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 63/118] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:01.984673 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bde36108-029c-44e9-b0ad-6b46fdd0a623 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:01.994930 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bde36108-029c-44e9-b0ad-6b46fdd0a623 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.278923 Jun 23 20:08:02.000803 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 56/119] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:01 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:02.171550 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d59109d1-35df-4d0d-8940-eff1c9743784 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:02.172259 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d59109d1-35df-4d0d-8940-eff1c9743784 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:02.186562 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d59109d1-35df-4d0d-8940-eff1c9743784 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:02.187010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d59109d1-35df-4d0d-8940-eff1c9743784 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:02.187784 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d59109d1-35df-4d0d-8940-eff1c9743784 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:02.188216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d59109d1-35df-4d0d-8940-eff1c9743784 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:02.458886 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d59109d1-35df-4d0d-8940-eff1c9743784 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:02.466493 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d59109d1-35df-4d0d-8940-eff1c9743784 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1554 microversion: 2.1 time: 0.299101 Jun 23 20:08:02.467069 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 64/120] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:02 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1554 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:02.485045 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0c447ad0-180d-4958-b4ee-c1368c7d18c9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:02.486197 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0c447ad0-180d-4958-b4ee-c1368c7d18c9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:02.498878 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0c447ad0-180d-4958-b4ee-c1368c7d18c9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:02.498878 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0c447ad0-180d-4958-b4ee-c1368c7d18c9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:02.498878 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0c447ad0-180d-4958-b4ee-c1368c7d18c9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:02.498878 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0c447ad0-180d-4958-b4ee-c1368c7d18c9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:02.611640 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0c447ad0-180d-4958-b4ee-c1368c7d18c9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122864 Jun 23 20:08:02.611640 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 57/121] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 23 20:08:02 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:02.871160 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9b41e437-0315-4abc-adea-be58f5654f3f tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:02.872401 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9b41e437-0315-4abc-adea-be58f5654f3f tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:02.882980 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9b41e437-0315-4abc-adea-be58f5654f3f tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:02.886048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9b41e437-0315-4abc-adea-be58f5654f3f tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:02.887360 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9b41e437-0315-4abc-adea-be58f5654f3f tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:02.889140 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9b41e437-0315-4abc-adea-be58f5654f3f tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:03.018346 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-17b3a49a-c2f8-468d-ad3d-7c44eb522f25 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:03.019216 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-17b3a49a-c2f8-468d-ad3d-7c44eb522f25 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:03.026298 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17b3a49a-c2f8-468d-ad3d-7c44eb522f25 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:03.026940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17b3a49a-c2f8-468d-ad3d-7c44eb522f25 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:03.028581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17b3a49a-c2f8-468d-ad3d-7c44eb522f25 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:03.029178 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-17b3a49a-c2f8-468d-ad3d-7c44eb522f25 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:03.762861 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9b41e437-0315-4abc-adea-be58f5654f3f tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:03.776024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9b41e437-0315-4abc-adea-be58f5654f3f tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1502 microversion: 2.1 time: 0.908982 Jun 23 20:08:03.788062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 65/122] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:02 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1502 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:03.788250 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-17b3a49a-c2f8-468d-ad3d-7c44eb522f25 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:03.797542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-17b3a49a-c2f8-468d-ad3d-7c44eb522f25 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.786326 Jun 23 20:08:03.812559 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 58/123] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:03 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:04.817789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bf0bbc82-1fe7-44fe-b1b7-454835ad150b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:04.818570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bf0bbc82-1fe7-44fe-b1b7-454835ad150b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:04.828517 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bf0bbc82-1fe7-44fe-b1b7-454835ad150b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:04.833020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bf0bbc82-1fe7-44fe-b1b7-454835ad150b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:04.834068 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bf0bbc82-1fe7-44fe-b1b7-454835ad150b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:04.834516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bf0bbc82-1fe7-44fe-b1b7-454835ad150b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:05.050011 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-26efbdbc-b4b8-4048-acdb-7672a1d19042 req-fa350492-46dd-4f51-b557-45dc8802ccd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c507d545-f924-49b1-91db-92efe489eed7", "tag": "e2d0d115-8902-4843-bd9b-e0319ca9a623"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:05.067894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-26efbdbc-b4b8-4048-acdb-7672a1d19042 req-fa350492-46dd-4f51-b557-45dc8802ccd3 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:05.068363 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-26efbdbc-b4b8-4048-acdb-7672a1d19042 req-fa350492-46dd-4f51-b557-45dc8802ccd3 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:05.099831 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-26efbdbc-b4b8-4048-acdb-7672a1d19042 req-fa350492-46dd-4f51-b557-45dc8802ccd3 service nova] Creating event network-changed:e2d0d115-8902-4843-bd9b-e0319ca9a623 for instance c507d545-f924-49b1-91db-92efe489eed7 on hv-cinder-84727 Jun 23 20:08:05.105872 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-26efbdbc-b4b8-4048-acdb-7672a1d19042 req-fa350492-46dd-4f51-b557-45dc8802ccd3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064969 Jun 23 20:08:05.107232 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 59/124] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:08:05.562215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-bf0bbc82-1fe7-44fe-b1b7-454835ad150b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:05.578491 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bf0bbc82-1fe7-44fe-b1b7-454835ad150b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.765383 Jun 23 20:08:05.581677 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 66/125] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:04 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:05.999395 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6f96e815-cb29-4cdd-b2ad-61305c771dcb tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "431c62e5-1b2e-4805-924f-8bea007922ab"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:06.003710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6f96e815-cb29-4cdd-b2ad-61305c771dcb tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:06.055238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f96e815-cb29-4cdd-b2ad-61305c771dcb tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:06.078104 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f96e815-cb29-4cdd-b2ad-61305c771dcb tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:06.078104 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f96e815-cb29-4cdd-b2ad-61305c771dcb tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:06.078104 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f96e815-cb29-4cdd-b2ad-61305c771dcb tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:06.604575 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-514564b2-b12d-42b0-bfeb-99bf1eb82a7b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:06.630231 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-514564b2-b12d-42b0-bfeb-99bf1eb82a7b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:06.654847 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:06.666975 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-514564b2-b12d-42b0-bfeb-99bf1eb82a7b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:06.666975 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-514564b2-b12d-42b0-bfeb-99bf1eb82a7b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:06.677933 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-514564b2-b12d-42b0-bfeb-99bf1eb82a7b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:06.679390 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-514564b2-b12d-42b0-bfeb-99bf1eb82a7b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:07.169205 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-514564b2-b12d-42b0-bfeb-99bf1eb82a7b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:07.177091 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-514564b2-b12d-42b0-bfeb-99bf1eb82a7b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.582234 Jun 23 20:08:07.180382 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 67/126] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:06 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:07.435124 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6f96e815-cb29-4cdd-b2ad-61305c771dcb tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "POST /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.441244 Jun 23 20:08:07.441176 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 60/127] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:08:05 2022] POST /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2/os-volume_attachments => generated 194 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:08.194526 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-99c6b895-ea58-42fb-b3fb-41b8a37c5861 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:08.195707 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-99c6b895-ea58-42fb-b3fb-41b8a37c5861 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:08.203630 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99c6b895-ea58-42fb-b3fb-41b8a37c5861 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:08.204442 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99c6b895-ea58-42fb-b3fb-41b8a37c5861 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:08.205436 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99c6b895-ea58-42fb-b3fb-41b8a37c5861 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:08.208995 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99c6b895-ea58-42fb-b3fb-41b8a37c5861 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:08.568954 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-99c6b895-ea58-42fb-b3fb-41b8a37c5861 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:08.577973 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-99c6b895-ea58-42fb-b3fb-41b8a37c5861 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.387170 Jun 23 20:08:08.578545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 68/128] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:08 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:09.599783 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-662653d8-6bfc-4d31-aa8d-aefd41c86721 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:09.606092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-662653d8-6bfc-4d31-aa8d-aefd41c86721 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:09.620638 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-662653d8-6bfc-4d31-aa8d-aefd41c86721 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:09.621927 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-662653d8-6bfc-4d31-aa8d-aefd41c86721 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:09.624051 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-662653d8-6bfc-4d31-aa8d-aefd41c86721 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:09.625604 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-662653d8-6bfc-4d31-aa8d-aefd41c86721 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:09.887888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-662653d8-6bfc-4d31-aa8d-aefd41c86721 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:09.901894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-662653d8-6bfc-4d31-aa8d-aefd41c86721 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.310518 Jun 23 20:08:09.902485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 61/129] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:09 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:10.919306 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5dfe9ab0-579a-464f-a731-4dd4f8dea05a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:10.919925 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5dfe9ab0-579a-464f-a731-4dd4f8dea05a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:10.928137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5dfe9ab0-579a-464f-a731-4dd4f8dea05a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:10.930818 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5dfe9ab0-579a-464f-a731-4dd4f8dea05a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:10.932262 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5dfe9ab0-579a-464f-a731-4dd4f8dea05a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:10.934228 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5dfe9ab0-579a-464f-a731-4dd4f8dea05a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:11.258396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5dfe9ab0-579a-464f-a731-4dd4f8dea05a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:11.268461 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5dfe9ab0-579a-464f-a731-4dd4f8dea05a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.353146 Jun 23 20:08:11.269276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 69/130] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:10 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:12.288556 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3b5a7172-06c8-459f-b9bb-670c1cdeed0e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:12.289191 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3b5a7172-06c8-459f-b9bb-670c1cdeed0e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:12.294410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=91 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:12.296345 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b5a7172-06c8-459f-b9bb-670c1cdeed0e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:12.296796 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b5a7172-06c8-459f-b9bb-670c1cdeed0e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:12.298286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b5a7172-06c8-459f-b9bb-670c1cdeed0e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:12.298727 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b5a7172-06c8-459f-b9bb-670c1cdeed0e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:12.367282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-47a1d7af-944f-43b1-b230-0e3452944d66 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Action: 'create', calling method: .version_select at 0x7f90da13e280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-841892012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0OABe9RNlx7yna8NWNYVzQcUopqQ8KYXLZS2gl6D0fQ/WKddkFmb/WuQjx1iokEMuPIcEhNl6ZkyKuDuFo71L4H586FXg1cvVMkZRCQveFvtxNyYP8a5ScuuaRcVEsjw=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:12.382337 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-47a1d7af-944f-43b1-b230-0e3452944d66 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Getting quotas for project edb569a8b39a437ea8be940df098268c. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:08:12.391996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-47a1d7af-944f-43b1-b230-0e3452944d66 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Getting quotas for user eafea4329d6243459dd3a6add1e91a2e and project edb569a8b39a437ea8be940df098268c. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:08:12.468783 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3b5a7172-06c8-459f-b9bb-670c1cdeed0e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:12.478945 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3b5a7172-06c8-459f-b9bb-670c1cdeed0e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.196797 Jun 23 20:08:12.479706 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 70/131] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:12 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:12.499936 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-47a1d7af-944f-43b1-b230-0e3452944d66 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.436377 Jun 23 20:08:12.509088 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 62/132] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:08:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:13.499315 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-10353138-bf79-4bb8-859f-aadccf9f87c2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:13.500804 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-10353138-bf79-4bb8-859f-aadccf9f87c2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:13.508822 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-10353138-bf79-4bb8-859f-aadccf9f87c2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:13.509593 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-10353138-bf79-4bb8-859f-aadccf9f87c2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:13.510602 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-10353138-bf79-4bb8-859f-aadccf9f87c2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:13.511044 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-10353138-bf79-4bb8-859f-aadccf9f87c2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:13.718531 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-10353138-bf79-4bb8-859f-aadccf9f87c2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:13.726014 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-10353138-bf79-4bb8-859f-aadccf9f87c2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.230602 Jun 23 20:08:13.726805 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 71/133] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:13 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:14.742838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-70330221-03ab-47f5-95e3-296c07a9d03f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:14.743647 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-70330221-03ab-47f5-95e3-296c07a9d03f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:14.746210 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:14.751832 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-70330221-03ab-47f5-95e3-296c07a9d03f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:14.752509 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-70330221-03ab-47f5-95e3-296c07a9d03f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:14.753274 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-70330221-03ab-47f5-95e3-296c07a9d03f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:14.753709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-70330221-03ab-47f5-95e3-296c07a9d03f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:14.924951 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-70330221-03ab-47f5-95e3-296c07a9d03f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:14.932577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-70330221-03ab-47f5-95e3-296c07a9d03f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.193623 Jun 23 20:08:14.933077 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 63/134] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:14 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:15.950449 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-642f27f7-d576-4caf-9a2d-367f8cd1d495 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:15.951059 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-642f27f7-d576-4caf-9a2d-367f8cd1d495 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:15.959791 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-642f27f7-d576-4caf-9a2d-367f8cd1d495 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:15.960527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-642f27f7-d576-4caf-9a2d-367f8cd1d495 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:15.961572 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-642f27f7-d576-4caf-9a2d-367f8cd1d495 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:15.962354 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-642f27f7-d576-4caf-9a2d-367f8cd1d495 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:16.150440 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-642f27f7-d576-4caf-9a2d-367f8cd1d495 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:16.161048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-642f27f7-d576-4caf-9a2d-367f8cd1d495 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.213913 Jun 23 20:08:16.165145 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 72/135] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:15 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:17.178293 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-44835412-38f0-45ff-ac9b-2a115c3bb7b2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:17.178890 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-44835412-38f0-45ff-ac9b-2a115c3bb7b2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:17.186002 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-44835412-38f0-45ff-ac9b-2a115c3bb7b2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:17.186445 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-44835412-38f0-45ff-ac9b-2a115c3bb7b2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:17.189311 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-44835412-38f0-45ff-ac9b-2a115c3bb7b2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:17.189311 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-44835412-38f0-45ff-ac9b-2a115c3bb7b2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:17.330296 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-44835412-38f0-45ff-ac9b-2a115c3bb7b2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:17.338278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-44835412-38f0-45ff-ac9b-2a115c3bb7b2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.163857 Jun 23 20:08:17.338862 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 64/136] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:17 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:18.356052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bc19efc2-b28c-4a54-b9cc-8382273faf8b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:18.356794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bc19efc2-b28c-4a54-b9cc-8382273faf8b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:18.363289 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bc19efc2-b28c-4a54-b9cc-8382273faf8b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:18.363822 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bc19efc2-b28c-4a54-b9cc-8382273faf8b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:18.364618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bc19efc2-b28c-4a54-b9cc-8382273faf8b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:18.365087 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bc19efc2-b28c-4a54-b9cc-8382273faf8b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:18.501920 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-bc19efc2-b28c-4a54-b9cc-8382273faf8b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:18.510417 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bc19efc2-b28c-4a54-b9cc-8382273faf8b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.158243 Jun 23 20:08:18.510977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 73/137] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:18 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:19.527321 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-945118ee-dbf4-45a9-8528-be0d9eed0166 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:19.527933 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-945118ee-dbf4-45a9-8528-be0d9eed0166 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:19.534921 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-945118ee-dbf4-45a9-8528-be0d9eed0166 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:19.535706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-945118ee-dbf4-45a9-8528-be0d9eed0166 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:19.536542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-945118ee-dbf4-45a9-8528-be0d9eed0166 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:19.537055 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-945118ee-dbf4-45a9-8528-be0d9eed0166 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:19.698997 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-945118ee-dbf4-45a9-8528-be0d9eed0166 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:19.707202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-945118ee-dbf4-45a9-8528-be0d9eed0166 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.183814 Jun 23 20:08:19.708245 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 65/138] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:19 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:20.734319 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-11415ba2-453b-471f-93b7-726d99defce3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:20.734954 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-11415ba2-453b-471f-93b7-726d99defce3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:20.741489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-11415ba2-453b-471f-93b7-726d99defce3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:20.741932 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-11415ba2-453b-471f-93b7-726d99defce3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:20.742666 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-11415ba2-453b-471f-93b7-726d99defce3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:20.743153 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-11415ba2-453b-471f-93b7-726d99defce3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:20.870097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-11415ba2-453b-471f-93b7-726d99defce3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:20.879222 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-11415ba2-453b-471f-93b7-726d99defce3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.148508 Jun 23 20:08:20.880001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 74/139] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:20 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:21.602246 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d9f055c9-bda7-486c-a022-6db916386124 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:21.602246 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d9f055c9-bda7-486c-a022-6db916386124 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:21.608647 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9f055c9-bda7-486c-a022-6db916386124 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:21.609092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9f055c9-bda7-486c-a022-6db916386124 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:21.609856 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9f055c9-bda7-486c-a022-6db916386124 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:21.610284 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9f055c9-bda7-486c-a022-6db916386124 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:21.638106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d9f055c9-bda7-486c-a022-6db916386124 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:08:21.899557 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c61bdffa-4c71-4730-b625-aef0d429e8aa tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:21.900525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c61bdffa-4c71-4730-b625-aef0d429e8aa tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:21.909275 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c61bdffa-4c71-4730-b625-aef0d429e8aa tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:21.909983 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c61bdffa-4c71-4730-b625-aef0d429e8aa tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:21.911179 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c61bdffa-4c71-4730-b625-aef0d429e8aa tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:21.911818 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c61bdffa-4c71-4730-b625-aef0d429e8aa tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:21.917639 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=100 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:21.972074 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d9f055c9-bda7-486c-a022-6db916386124 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "DELETE /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 204 len: 0 microversion: 2.1 time: 0.374199 Jun 23 20:08:21.972761 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 66/140] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:08:21 2022] DELETE /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:08:21.984479 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-92789ffb-6a95-4283-acdb-afa7e08e0246 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:21.985160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-92789ffb-6a95-4283-acdb-afa7e08e0246 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:21.992098 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92789ffb-6a95-4283-acdb-afa7e08e0246 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:21.992618 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92789ffb-6a95-4283-acdb-afa7e08e0246 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:21.993384 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92789ffb-6a95-4283-acdb-afa7e08e0246 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:21.993817 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92789ffb-6a95-4283-acdb-afa7e08e0246 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:22.402804 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:22.418770 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c61bdffa-4c71-4730-b625-aef0d429e8aa tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:22.429691 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c61bdffa-4c71-4730-b625-aef0d429e8aa tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.535730 Jun 23 20:08:22.430417 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-92789ffb-6a95-4283-acdb-afa7e08e0246 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:22.439647 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 75/141] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:21 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:22.452573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-92789ffb-6a95-4283-acdb-afa7e08e0246 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1554 microversion: 2.1 time: 0.471862 Jun 23 20:08:22.456619 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 67/142] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:21 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1554 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:23.447577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-099bac64-6e81-4d68-8a35-bdbf3d125257 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:23.447929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-099bac64-6e81-4d68-8a35-bdbf3d125257 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:23.456737 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-099bac64-6e81-4d68-8a35-bdbf3d125257 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:23.457191 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-099bac64-6e81-4d68-8a35-bdbf3d125257 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:23.457955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-099bac64-6e81-4d68-8a35-bdbf3d125257 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:23.458670 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-099bac64-6e81-4d68-8a35-bdbf3d125257 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:23.473510 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-79dd4d95-d2b3-4323-9d22-fbaf945efaef tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:23.474821 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-79dd4d95-d2b3-4323-9d22-fbaf945efaef tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:23.484268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79dd4d95-d2b3-4323-9d22-fbaf945efaef tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:23.488342 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79dd4d95-d2b3-4323-9d22-fbaf945efaef tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:23.488342 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79dd4d95-d2b3-4323-9d22-fbaf945efaef tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:23.488342 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-79dd4d95-d2b3-4323-9d22-fbaf945efaef tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:23.724873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-099bac64-6e81-4d68-8a35-bdbf3d125257 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:23.732514 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-099bac64-6e81-4d68-8a35-bdbf3d125257 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1522 microversion: 2.1 time: 0.289441 Jun 23 20:08:23.733381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 76/143] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:23 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:23.761036 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-79dd4d95-d2b3-4323-9d22-fbaf945efaef tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:23.770186 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-79dd4d95-d2b3-4323-9d22-fbaf945efaef tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1554 microversion: 2.1 time: 0.305233 Jun 23 20:08:23.770955 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 68/144] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:23 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:24.750276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-03b599e1-97c7-438f-8f6d-ed999265b9a4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:24.750867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-03b599e1-97c7-438f-8f6d-ed999265b9a4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:24.756966 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-03b599e1-97c7-438f-8f6d-ed999265b9a4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:24.757410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-03b599e1-97c7-438f-8f6d-ed999265b9a4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:24.758192 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-03b599e1-97c7-438f-8f6d-ed999265b9a4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:24.758618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-03b599e1-97c7-438f-8f6d-ed999265b9a4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:24.792269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d2bcff1a-f117-4f0e-b331-4b111f6db4a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:24.797331 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d2bcff1a-f117-4f0e-b331-4b111f6db4a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:24.805785 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2bcff1a-f117-4f0e-b331-4b111f6db4a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:24.806240 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2bcff1a-f117-4f0e-b331-4b111f6db4a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:24.807061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2bcff1a-f117-4f0e-b331-4b111f6db4a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:24.808119 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2bcff1a-f117-4f0e-b331-4b111f6db4a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:24.962891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-03b599e1-97c7-438f-8f6d-ed999265b9a4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:24.970955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-03b599e1-97c7-438f-8f6d-ed999265b9a4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1502 microversion: 2.1 time: 0.224514 Jun 23 20:08:24.971770 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 77/145] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:24 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:24.989160 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-675855de-5866-4f81-ad4f-75641b51eddd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:24.990131 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-675855de-5866-4f81-ad4f-75641b51eddd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:24.997638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-675855de-5866-4f81-ad4f-75641b51eddd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:24.999038 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-675855de-5866-4f81-ad4f-75641b51eddd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:25.000126 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-675855de-5866-4f81-ad4f-75641b51eddd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:25.000816 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-675855de-5866-4f81-ad4f-75641b51eddd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:25.011145 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d2bcff1a-f117-4f0e-b331-4b111f6db4a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:25.021999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d2bcff1a-f117-4f0e-b331-4b111f6db4a0 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1554 microversion: 2.1 time: 0.238344 Jun 23 20:08:25.037210 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 69/146] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:24 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:25.154335 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-675855de-5866-4f81-ad4f-75641b51eddd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:25.161899 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-675855de-5866-4f81-ad4f-75641b51eddd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1515 microversion: 2.1 time: 0.176934 Jun 23 20:08:25.162472 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 78/147] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:24 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:26.044939 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8195a3e5-888d-491d-8fbc-9fba16dd5e42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:26.048842 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8195a3e5-888d-491d-8fbc-9fba16dd5e42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:26.059925 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8195a3e5-888d-491d-8fbc-9fba16dd5e42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:26.062309 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8195a3e5-888d-491d-8fbc-9fba16dd5e42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:26.063122 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8195a3e5-888d-491d-8fbc-9fba16dd5e42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:26.064019 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8195a3e5-888d-491d-8fbc-9fba16dd5e42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:26.075342 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-3f9243ac-b348-42bc-a299-1b52bf5e8bdb req-8daf374c-fa36-47bd-ae1f-d0e4cd0d47ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380622ce-1095-4eba-857e-8139ece728c2", "name": "network-vif-deleted", "tag": "46644b54-9e8f-46fa-9bb2-1bb72492e903"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:26.084735 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3f9243ac-b348-42bc-a299-1b52bf5e8bdb req-8daf374c-fa36-47bd-ae1f-d0e4cd0d47ce service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:26.085178 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3f9243ac-b348-42bc-a299-1b52bf5e8bdb req-8daf374c-fa36-47bd-ae1f-d0e4cd0d47ce service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:26.102645 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-3f9243ac-b348-42bc-a299-1b52bf5e8bdb req-8daf374c-fa36-47bd-ae1f-d0e4cd0d47ce service nova] Creating event network-vif-deleted:46644b54-9e8f-46fa-9bb2-1bb72492e903 for instance 380622ce-1095-4eba-857e-8139ece728c2 on hv-cinder-84727 Jun 23 20:08:26.110019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-3f9243ac-b348-42bc-a299-1b52bf5e8bdb req-8daf374c-fa36-47bd-ae1f-d0e4cd0d47ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039542 Jun 23 20:08:26.110666 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 79/148] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:08:26.173776 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8195a3e5-888d-491d-8fbc-9fba16dd5e42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:26.196373 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8195a3e5-888d-491d-8fbc-9fba16dd5e42 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1512 microversion: 2.1 time: 0.157113 Jun 23 20:08:26.197224 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 70/149] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:26 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:27.103390 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-445d2623-8c53-4e17-a76a-ac45c1fbf244 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:27.104435 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-445d2623-8c53-4e17-a76a-ac45c1fbf244 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:27.111283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-445d2623-8c53-4e17-a76a-ac45c1fbf244 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:27.113703 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-445d2623-8c53-4e17-a76a-ac45c1fbf244 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:27.113703 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-445d2623-8c53-4e17-a76a-ac45c1fbf244 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:27.113703 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-445d2623-8c53-4e17-a76a-ac45c1fbf244 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:27.136060 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-445d2623-8c53-4e17-a76a-ac45c1fbf244 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lazy-loading 'flavor' on Instance uuid ade71e5a-f39d-4c61-8364-fd629f524922 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:08:27.217042 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:27.217782 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:27.225012 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:27.237602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:27.237602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:27.237602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:27.275165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:27.275614 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:27.276082 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lazy-loading 'fault' on Instance uuid 380622ce-1095-4eba-857e-8139ece728c2 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:08:27.321397 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645338e8194426eac77359c0cb233f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32672f6e771b4d37986e48e0091b6877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:27.334520 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ee322bfb-4ea5-4921-a35b-919f0e71df61 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 200 len: 1351 microversion: 2.1 time: 0.121298 Jun 23 20:08:27.335330 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 71/150] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:27 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:27.486369 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-445d2623-8c53-4e17-a76a-ac45c1fbf244 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922/action" status: 200 len: 32 microversion: 2.1 time: 0.386260 Jun 23 20:08:27.499555 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 80/151] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:08:27 2022] POST /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922/action => generated 32 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 20:08:27.500813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-869a231c-08df-4bc3-8b12-ef271681ea15 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:27.501463 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-869a231c-08df-4bc3-8b12-ef271681ea15 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:27.508873 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-869a231c-08df-4bc3-8b12-ef271681ea15 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:27.510470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-869a231c-08df-4bc3-8b12-ef271681ea15 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:27.511281 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-869a231c-08df-4bc3-8b12-ef271681ea15 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:27.511738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-869a231c-08df-4bc3-8b12-ef271681ea15 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:27.696266 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-869a231c-08df-4bc3-8b12-ef271681ea15 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:27.712088 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-869a231c-08df-4bc3-8b12-ef271681ea15 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.210665 Jun 23 20:08:27.713108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 72/152] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:27 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:28.352753 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:28.353972 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:28.363171 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:28.363171 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:28.363563 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:28.364152 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:28.381038 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] HTTP exception thrown: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Request method failure captured: Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 HTTP/1.1 Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMf0gGErU_r1S79BVNTHhnj90H_AkXaI2dxt-Fw3deyMYLYVbduG-kdHkE4YUl6gSmmjTd3nwL1ugtA76gV_3Mw9GdZHPoerxBVUQ6GRxhFCnAScEnYBrkXxn57qLPMIS463iLfvE5xVKqzrtIoCXFRnxYmivUiJdcwMR2p5c0wdLNc Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 32672f6e771b4d37986e48e0091b6877 Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:08:28.385953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32672f6e771b4d37986e48e0091b6877", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32672f6e771b4d37986e48e0091b6877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32672f6e771b4d37986e48e0091b6877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32672f6e771b4d37986e48e0091b6877"}]}] Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 32672f6e771b4d37986e48e0091b6877 Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-DeleteServersTestJSON-1504983193-project Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 5645338e8194426eac77359c0cb233f5 Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-DeleteServersTestJSON-1504983193-project Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:28.393330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '380622ce-1095-4eba-857e-8139ece728c2'} Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:08:28.394682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:28.395841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:28.396970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Returning 404 to user: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:08:28.396970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fc6eb74f-9cb9-4323-9394-24852cf926e9 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 404 len: 111 microversion: 2.1 time: 0.039160 Jun 23 20:08:28.396970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 81/153] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:28 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:08:28.729741 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4cfebac2-9bc8-41b1-bd38-dc0ac72d43ef tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:28.730398 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4cfebac2-9bc8-41b1-bd38-dc0ac72d43ef tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:28.737722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4cfebac2-9bc8-41b1-bd38-dc0ac72d43ef tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:28.738170 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4cfebac2-9bc8-41b1-bd38-dc0ac72d43ef tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:28.738930 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4cfebac2-9bc8-41b1-bd38-dc0ac72d43ef tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:28.739366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4cfebac2-9bc8-41b1-bd38-dc0ac72d43ef tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:28.870476 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4cfebac2-9bc8-41b1-bd38-dc0ac72d43ef tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:28.878082 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4cfebac2-9bc8-41b1-bd38-dc0ac72d43ef tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.152931 Jun 23 20:08:28.878639 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 73/154] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:28 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:29.409614 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:29.411057 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:29.427864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:29.427864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:29.427864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:29.427864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:29.462395 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] HTTP exception thrown: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Request method failure captured: Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2/os-volume_attachments HTTP/1.1 Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMf0gGErU_r1S79BVNTHhnj90H_AkXaI2dxt-Fw3deyMYLYVbduG-kdHkE4YUl6gSmmjTd3nwL1ugtA76gV_3Mw9GdZHPoerxBVUQ6GRxhFCnAScEnYBrkXxn57qLPMIS463iLfvE5xVKqzrtIoCXFRnxYmivUiJdcwMR2p5c0wdLNc Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 32672f6e771b4d37986e48e0091b6877 Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:08:29.464941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32672f6e771b4d37986e48e0091b6877", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32672f6e771b4d37986e48e0091b6877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32672f6e771b4d37986e48e0091b6877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32672f6e771b4d37986e48e0091b6877"}]}] Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 32672f6e771b4d37986e48e0091b6877 Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-DeleteServersTestJSON-1504983193-project Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 5645338e8194426eac77359c0cb233f5 Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-DeleteServersTestJSON-1504983193-project Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:29.466489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'server_id': '380622ce-1095-4eba-857e-8139ece728c2'} Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:08:29.467296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:29.468921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:29.470115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Returning 404 to user: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:08:29.470115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-adecce83-f0d6-438f-a498-13148365f89a tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062152 Jun 23 20:08:29.470115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 82/155] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:08:29 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:08:29.895133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9395f6c1-1531-4d45-9d8d-d7c715fa95b0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:29.895667 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9395f6c1-1531-4d45-9d8d-d7c715fa95b0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:29.902252 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9395f6c1-1531-4d45-9d8d-d7c715fa95b0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:29.902702 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9395f6c1-1531-4d45-9d8d-d7c715fa95b0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:29.903493 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9395f6c1-1531-4d45-9d8d-d7c715fa95b0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:29.903926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9395f6c1-1531-4d45-9d8d-d7c715fa95b0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:30.036154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9395f6c1-1531-4d45-9d8d-d7c715fa95b0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:30.043681 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9395f6c1-1531-4d45-9d8d-d7c715fa95b0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.152572 Jun 23 20:08:30.044251 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 74/156] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:29 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:31.061603 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-068cc5d0-4ac0-4cd2-80f0-8faa4b4abbfc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:31.062116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-068cc5d0-4ac0-4cd2-80f0-8faa4b4abbfc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:31.069360 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-068cc5d0-4ac0-4cd2-80f0-8faa4b4abbfc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:31.069872 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-068cc5d0-4ac0-4cd2-80f0-8faa4b4abbfc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:31.070637 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-068cc5d0-4ac0-4cd2-80f0-8faa4b4abbfc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:31.071233 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-068cc5d0-4ac0-4cd2-80f0-8faa4b4abbfc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:31.207550 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-068cc5d0-4ac0-4cd2-80f0-8faa4b4abbfc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:31.220828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-068cc5d0-4ac0-4cd2-80f0-8faa4b4abbfc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.157986 Jun 23 20:08:31.220828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 83/157] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:31 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:31.990830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:31.991351 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:31.998828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:31.999616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:32.000780 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:32.002070 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:32.017996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] HTTP exception thrown: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Request method failure captured: Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 HTTP/1.1 Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMf0gGErU_r1S79BVNTHhnj90H_AkXaI2dxt-Fw3deyMYLYVbduG-kdHkE4YUl6gSmmjTd3nwL1ugtA76gV_3Mw9GdZHPoerxBVUQ6GRxhFCnAScEnYBrkXxn57qLPMIS463iLfvE5xVKqzrtIoCXFRnxYmivUiJdcwMR2p5c0wdLNc Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 32672f6e771b4d37986e48e0091b6877 Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:08:32.023039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32672f6e771b4d37986e48e0091b6877", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32672f6e771b4d37986e48e0091b6877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32672f6e771b4d37986e48e0091b6877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32672f6e771b4d37986e48e0091b6877"}]}] Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 32672f6e771b4d37986e48e0091b6877 Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-DeleteServersTestJSON-1504983193-project Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 5645338e8194426eac77359c0cb233f5 Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-DeleteServersTestJSON-1504983193-project Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.024450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '380622ce-1095-4eba-857e-8139ece728c2'} Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:08:32.025228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.026501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.028779 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Returning 404 to user: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:08:32.030515 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a3ccf60f-fa55-414c-908a-e0a48729dd40 tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "DELETE /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 404 len: 111 microversion: 2.1 time: 0.043670 Jun 23 20:08:32.035082 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 75/158] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:08:31 2022] DELETE /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:08:32.044328 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:32.045022 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] [instance: 380622ce-1095-4eba-857e-8139ece728c2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:32.051956 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:32.053053 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:32.054001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:32.054709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:32.069660 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] HTTP exception thrown: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Request method failure captured: Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 HTTP/1.1 Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMf0gGErU_r1S79BVNTHhnj90H_AkXaI2dxt-Fw3deyMYLYVbduG-kdHkE4YUl6gSmmjTd3nwL1ugtA76gV_3Mw9GdZHPoerxBVUQ6GRxhFCnAScEnYBrkXxn57qLPMIS463iLfvE5xVKqzrtIoCXFRnxYmivUiJdcwMR2p5c0wdLNc Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 32672f6e771b4d37986e48e0091b6877 Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:08:32.071313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32672f6e771b4d37986e48e0091b6877", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32672f6e771b4d37986e48e0091b6877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32672f6e771b4d37986e48e0091b6877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32672f6e771b4d37986e48e0091b6877"}]}] Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 32672f6e771b4d37986e48e0091b6877 Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504983193 Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-DeleteServersTestJSON-1504983193-project Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 5645338e8194426eac77359c0cb233f5 Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-DeleteServersTestJSON-1504983193-project Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.073040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '380622ce-1095-4eba-857e-8139ece728c2'} Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:08:32.073831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. Jun 23 20:08:32.075103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:08:32.076288 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] Returning 404 to user: Instance 380622ce-1095-4eba-857e-8139ece728c2 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:08:32.076288 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f8dc1483-8c11-4f4a-b11c-35b33e98563d tempest-DeleteServersTestJSON-1504983193 tempest-DeleteServersTestJSON-1504983193-project] 10.222.0.44 "GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2" status: 404 len: 111 microversion: 2.1 time: 0.034685 Jun 23 20:08:32.076288 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 84/159] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:32 2022] GET /compute/v2.1/servers/380622ce-1095-4eba-857e-8139ece728c2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:08:32.238178 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2de78aac-51ba-42dc-982e-7f9139defcf3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:32.238850 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2de78aac-51ba-42dc-982e-7f9139defcf3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:32.246075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2de78aac-51ba-42dc-982e-7f9139defcf3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:32.246615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2de78aac-51ba-42dc-982e-7f9139defcf3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:32.247688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2de78aac-51ba-42dc-982e-7f9139defcf3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:32.248160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2de78aac-51ba-42dc-982e-7f9139defcf3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:32.253997 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:32.382391 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2de78aac-51ba-42dc-982e-7f9139defcf3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:32.390426 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2de78aac-51ba-42dc-982e-7f9139defcf3 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.157243 Jun 23 20:08:32.391142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 76/160] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:32 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:33.409666 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-17b05fa6-b196-407d-9067-663675f89b6e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:33.410245 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-17b05fa6-b196-407d-9067-663675f89b6e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:33.416521 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-17b05fa6-b196-407d-9067-663675f89b6e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:33.416967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-17b05fa6-b196-407d-9067-663675f89b6e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:33.417791 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-17b05fa6-b196-407d-9067-663675f89b6e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:33.418229 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-17b05fa6-b196-407d-9067-663675f89b6e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:33.568089 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-17b05fa6-b196-407d-9067-663675f89b6e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:33.576437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-17b05fa6-b196-407d-9067-663675f89b6e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.170703 Jun 23 20:08:33.585143 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 85/161] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:33 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:34.593663 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f423dadd-08ab-4bdc-96f0-2af83a807561 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:34.594270 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f423dadd-08ab-4bdc-96f0-2af83a807561 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:34.602022 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f423dadd-08ab-4bdc-96f0-2af83a807561 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:34.602473 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f423dadd-08ab-4bdc-96f0-2af83a807561 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:34.603236 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f423dadd-08ab-4bdc-96f0-2af83a807561 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:34.603677 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f423dadd-08ab-4bdc-96f0-2af83a807561 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:34.745559 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f423dadd-08ab-4bdc-96f0-2af83a807561 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:34.756694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f423dadd-08ab-4bdc-96f0-2af83a807561 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.166789 Jun 23 20:08:34.771627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 77/162] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:34 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:35.778648 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d03737e1-0bc3-4bd9-847e-7049b62d6113 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:35.779387 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d03737e1-0bc3-4bd9-847e-7049b62d6113 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:35.787451 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d03737e1-0bc3-4bd9-847e-7049b62d6113 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:35.788547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d03737e1-0bc3-4bd9-847e-7049b62d6113 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:35.790499 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d03737e1-0bc3-4bd9-847e-7049b62d6113 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:35.790499 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d03737e1-0bc3-4bd9-847e-7049b62d6113 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:35.957587 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d03737e1-0bc3-4bd9-847e-7049b62d6113 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:35.970840 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d03737e1-0bc3-4bd9-847e-7049b62d6113 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.196697 Jun 23 20:08:35.977119 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 86/163] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:35 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:36.988405 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-22fde102-1ba2-410c-8c07-64e009fe00dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:36.989043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-22fde102-1ba2-410c-8c07-64e009fe00dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:36.995995 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-22fde102-1ba2-410c-8c07-64e009fe00dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:36.996497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-22fde102-1ba2-410c-8c07-64e009fe00dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:36.997265 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-22fde102-1ba2-410c-8c07-64e009fe00dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:36.997705 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-22fde102-1ba2-410c-8c07-64e009fe00dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:37.128696 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-22fde102-1ba2-410c-8c07-64e009fe00dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:37.136405 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-22fde102-1ba2-410c-8c07-64e009fe00dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.151952 Jun 23 20:08:37.136991 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 78/164] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:36 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:38.154461 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ac53e5fa-3c62-4446-aed7-8bc11d32df59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:38.155130 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ac53e5fa-3c62-4446-aed7-8bc11d32df59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:38.163723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ac53e5fa-3c62-4446-aed7-8bc11d32df59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:38.164537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ac53e5fa-3c62-4446-aed7-8bc11d32df59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:38.165517 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ac53e5fa-3c62-4446-aed7-8bc11d32df59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:38.166236 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ac53e5fa-3c62-4446-aed7-8bc11d32df59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:38.360675 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ac53e5fa-3c62-4446-aed7-8bc11d32df59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:38.365634 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ac53e5fa-3c62-4446-aed7-8bc11d32df59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.215906 Jun 23 20:08:38.366373 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 87/165] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:38 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:38.583950 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9aa4076a-1ea0-4798-94aa-e6756a77d0d3 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] Action: 'create', calling method: .version_select at 0x7f90d9fe0160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1386930763", "metadata": {"Type": "work"}}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:39.297070 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9aa4076a-1ea0-4798-94aa-e6756a77d0d3 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.971412 Jun 23 20:08:39.297700 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 79/166] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jun 23 20:08:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 973 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 23 20:08:39.310609 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-cfd10a61-ca94-481a-ae18-c2b4a8a98e5b tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] Calling method '.version_select at 0x7f90da8950d0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:39.403586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-08630de8-fc77-465e-a035-f7eb6c2f3d9c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:39.403586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-08630de8-fc77-465e-a035-f7eb6c2f3d9c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:39.403933 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-cfd10a61-ca94-481a-ae18-c2b4a8a98e5b tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42" status: 200 len: 353 microversion: 2.1 time: 0.084229 Jun 23 20:08:39.403933 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 88/167] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:08:39 2022] GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:39.404061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08630de8-fc77-465e-a035-f7eb6c2f3d9c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:39.404061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08630de8-fc77-465e-a035-f7eb6c2f3d9c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:39.404061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08630de8-fc77-465e-a035-f7eb6c2f3d9c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:39.404061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08630de8-fc77-465e-a035-f7eb6c2f3d9c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:39.552907 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-08630de8-fc77-465e-a035-f7eb6c2f3d9c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:39.560728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-08630de8-fc77-465e-a035-f7eb6c2f3d9c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.182130 Jun 23 20:08:39.561291 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 80/168] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:39 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:40.415311 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9d51fac6-78c4-474c-8606-c5a38ce449ab tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] Calling method '.version_select at 0x7f90da7fd1f0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:40.477479 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9d51fac6-78c4-474c-8606-c5a38ce449ab tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42" status: 200 len: 354 microversion: 2.1 time: 0.065973 Jun 23 20:08:40.478768 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 89/169] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:08:40 2022] GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:40.493184 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cbe531ae-f53a-4c26-a597-afb25abda530 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] Calling method '.version_select at 0x7f90d9fda310>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:40.544511 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cbe531ae-f53a-4c26-a597-afb25abda530 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42" status: 200 len: 354 microversion: 2.1 time: 0.058574 Jun 23 20:08:40.545081 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 81/170] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:08:40 2022] GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:40.557297 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b0eb4ccd-6809-4bb5-89e0-49019fe047b2 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] Calling method '.version_select at 0x7f90da7fd8b0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:40.577900 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2da0e8c8-1557-4171-8ef0-840c4bd40eb7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:40.578635 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2da0e8c8-1557-4171-8ef0-840c4bd40eb7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:40.585333 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2da0e8c8-1557-4171-8ef0-840c4bd40eb7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:40.585781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2da0e8c8-1557-4171-8ef0-840c4bd40eb7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:40.586550 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2da0e8c8-1557-4171-8ef0-840c4bd40eb7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:40.587171 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2da0e8c8-1557-4171-8ef0-840c4bd40eb7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:40.731556 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2da0e8c8-1557-4171-8ef0-840c4bd40eb7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:40.740853 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2da0e8c8-1557-4171-8ef0-840c4bd40eb7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.166721 Jun 23 20:08:40.741557 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 82/171] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:40 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:40.836397 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b0eb4ccd-6809-4bb5-89e0-49019fe047b2 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42" status: 202 len: 0 microversion: 2.1 time: 0.282886 Jun 23 20:08:40.837017 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 90/172] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:08:40 2022] DELETE /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:08:40.846158 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6468d284-1465-4612-86b7-433b73d99d68 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] Calling method '.version_select at 0x7f90d9fda550>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:40.892146 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6468d284-1465-4612-86b7-433b73d99d68 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42" status: 200 len: 353 microversion: 2.1 time: 0.049888 Jun 23 20:08:40.892694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 83/173] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:08:40 2022] GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:08:41.632765 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1569160393", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-841892012", "security_groups": [{"name": "tempest-secgroup-smoke-1008165961"}], "block_device_mapping_v2": [{"uuid": "1fdc481d-8428-494c-8a1b-796f0bdb8b5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0be33fe-ef21-4463-bb71-a01e82ba375e"}]}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:41.758681 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-de7b2560-db7b-4a7c-a9ab-15a13672cf12 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:41.760011 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-de7b2560-db7b-4a7c-a9ab-15a13672cf12 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:41.766434 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de7b2560-db7b-4a7c-a9ab-15a13672cf12 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:41.767074 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de7b2560-db7b-4a7c-a9ab-15a13672cf12 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:41.767837 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de7b2560-db7b-4a7c-a9ab-15a13672cf12 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:41.768284 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de7b2560-db7b-4a7c-a9ab-15a13672cf12 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:41.771481 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] validate_networks() for [('e0be33fe-ef21-4463-bb71-a01e82ba375e', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:08:41.981598 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-de7b2560-db7b-4a7c-a9ab-15a13672cf12 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:41.992273 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-de7b2560-db7b-4a7c-a9ab-15a13672cf12 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.237952 Jun 23 20:08:41.996688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 84/174] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:41 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:42.002255 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-47835e4e-f3ae-4b29-bedc-1c4e1bd8c978 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] Calling method '.version_select at 0x7f90da297ee0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:42.031805 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-47835e4e-f3ae-4b29-bedc-1c4e1bd8c978 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] HTTP exception thrown: Volume c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 could not be found. Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-47835e4e-f3ae-4b29-bedc-1c4e1bd8c978 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] Request method failure captured: Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 HTTP/1.1 Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMhGJZCdeGvm9rmHrc_mDB1MfhglmzRtOvTMdVWtphhstFc0CaqcwJyufuLognSWIXv2KMMABt5PH1bg8coZBurp4h0dBQruVYX5GLGDQyQzKisvgwNC8gU1nAS13XS7UxK9-7v-b51UEzqJKSq_DaLr-nutWXr2gQkby-W39HZtaqE Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 8c7b02690ff34b6fb25d25e755d06a97 Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesGetTestJSON-290831901 Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:08:42.035740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8c7b02690ff34b6fb25d25e755d06a97", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c7b02690ff34b6fb25d25e755d06a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8c7b02690ff34b6fb25d25e755d06a97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8c7b02690ff34b6fb25d25e755d06a97"}]}] Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesGetTestJSON-290831901 Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 8c7b02690ff34b6fb25d25e755d06a97 Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesGetTestJSON-290831901 Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesGetTestJSON-290831901-project Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 734e54fa10cd4a12bc3df01de6fb604b Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesGetTestJSON-290831901-project Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Volume c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 could not be found. Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42'} Jun 23 20:08:42.037269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 could not be found. (HTTP 404) (Request-ID: req-99f5ab4a-d469-4987-8fb8-3af4850827e5) Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:42.038154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:08:42.039217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 could not be found. Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 20:08:42.040278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 could not be found. Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 could not be found. Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-47835e4e-f3ae-4b29-bedc-1c4e1bd8c978 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] Returning 404 to user: Volume c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:08:42.041314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-47835e4e-f3ae-4b29-bedc-1c4e1bd8c978 tempest-VolumesGetTestJSON-290831901 tempest-VolumesGetTestJSON-290831901-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42" status: 404 len: 109 microversion: 2.1 time: 0.043427 Jun 23 20:08:42.043984 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 85/175] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:08:41 2022] GET /compute/v2.1/os-volumes/c0b722ca-6bb6-4e4c-aee3-cb87ddad0e42 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:08:42.277763 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:08:42.277763 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:08:42.277763 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:08:42.278140 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:08:42.278430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:08:42.287350 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:42.287761 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:42.288830 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:42.289263 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:42.307365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Getting quotas for project edb569a8b39a437ea8be940df098268c. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:08:42.311316 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Getting quotas for user eafea4329d6243459dd3a6add1e91a2e and project edb569a8b39a437ea8be940df098268c. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:08:42.370455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:08:42.372562 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fdc481d-8428-494c-8a1b-796f0bdb8b5b',volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:08:42.923152 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b8b2d1a4-49b5-4f35-a9a7-73ace7639228 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.294386 Jun 23 20:08:42.935233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6d685e6d-4e84-4865-8690-6b505f9d9f05 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:42.935834 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6d685e6d-4e84-4865-8690-6b505f9d9f05 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:42.939778 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 91/176] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:08:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:08:43.011516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d49afa40-104f-43fb-aa9e-4100f2734a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:43.012644 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d49afa40-104f-43fb-aa9e-4100f2734a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:43.033817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d49afa40-104f-43fb-aa9e-4100f2734a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:43.033817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d49afa40-104f-43fb-aa9e-4100f2734a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:43.033817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d49afa40-104f-43fb-aa9e-4100f2734a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:43.033817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d49afa40-104f-43fb-aa9e-4100f2734a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:43.043646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6d685e6d-4e84-4865-8690-6b505f9d9f05 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:43.053423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6d685e6d-4e84-4865-8690-6b505f9d9f05 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1094 microversion: 2.1 time: 0.123041 Jun 23 20:08:43.055058 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 86/177] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:42 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1094 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:43.218983 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d49afa40-104f-43fb-aa9e-4100f2734a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:43.227021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d49afa40-104f-43fb-aa9e-4100f2734a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1501 microversion: 2.1 time: 0.220847 Jun 23 20:08:43.227551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 92/178] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:43 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:43.252097 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01289aac-4a3d-4b24-9f94-f7201de8f38b"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:43.253576 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:43.259817 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:43.260862 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:43.261695 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:43.262166 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:43.290878 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] HTTP exception thrown: Cannot 'attach_volume' instance ade71e5a-f39d-4c61-8364-fd629f524922 while it is in vm_state rescued Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Request method failure captured: Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: POST /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922/os-volume_attachments HTTP/1.1 Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 74 Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMfyxzsamWYAY4W_HtOHWWevrTKWC8RK4VJTVqs_TfC8PoEejL0VGty_DaRq72Ond_ur5yKbVnIGJB1lU8bRv9C_AbQd_Bs0vATjE74j-5caMuhy7j0rXIoUAsJTnACzMgvQ_haumEiGr9liO6idCPQubzNFUJivCbjspeWNnvni-HA Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:08:43.292868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf37c9d0240b48078038d70f678a93eb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf37c9d0240b48078038d70f678a93eb"}]}] Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: f041449191c94a5ca5a38c29dd146a15 Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {"volumeAttachment": {"volumeId": "01289aac-4a3d-4b24-9f94-f7201de8f38b"}} Jun 23 20:08:43.294199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Cannot 'attach_volume' instance ade71e5a-f39d-4c61-8364-fd629f524922 while it is in vm_state rescued Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'server_id': 'ade71e5a-f39d-4c61-8364-fd629f524922', 'body': {'volumeAttachment': {'volumeId': '01289aac-4a3d-4b24-9f94-f7201de8f38b'}}} Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ade71e5a-f39d-4c61-8364-fd629f524922 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:08:43.294896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ade71e5a-f39d-4c61-8364-fd629f524922 while it is in vm_state rescued Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:08:43.295970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:08:43.297077 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:08:43.297077 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:08:43.297077 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ade71e5a-f39d-4c61-8364-fd629f524922 while it is in vm_state rescued Jun 23 20:08:43.297077 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:08:43.299446 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Returning 409 to user: Cannot 'attach_volume' instance ade71e5a-f39d-4c61-8364-fd629f524922 while it is in vm_state rescued {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:08:43.300619 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-18c5d0e3-c3eb-46bf-a0d8-b39b5e9ac697 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053231 Jun 23 20:08:43.301761 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 87/179] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:08:43 2022] POST /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 20:08:43.310951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b8a51a9e-7bf2-4b46-bb4c-1b03d768960c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:43.311601 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b8a51a9e-7bf2-4b46-bb4c-1b03d768960c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:43.319692 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8a51a9e-7bf2-4b46-bb4c-1b03d768960c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:43.320174 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8a51a9e-7bf2-4b46-bb4c-1b03d768960c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:43.322101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8a51a9e-7bf2-4b46-bb4c-1b03d768960c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:43.322101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8a51a9e-7bf2-4b46-bb4c-1b03d768960c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:43.603831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b8a51a9e-7bf2-4b46-bb4c-1b03d768960c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922/action" status: 202 len: 0 microversion: 2.1 time: 0.297336 Jun 23 20:08:43.607820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 93/180] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:08:43 2022] POST /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:08:43.617412 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-340a0ddd-1021-490a-b67b-5529c4cd20b9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:43.618050 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-340a0ddd-1021-490a-b67b-5529c4cd20b9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:43.624690 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-340a0ddd-1021-490a-b67b-5529c4cd20b9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:43.625147 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-340a0ddd-1021-490a-b67b-5529c4cd20b9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:43.632994 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-340a0ddd-1021-490a-b67b-5529c4cd20b9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:43.633849 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-340a0ddd-1021-490a-b67b-5529c4cd20b9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:43.885906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-340a0ddd-1021-490a-b67b-5529c4cd20b9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:43.895902 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-340a0ddd-1021-490a-b67b-5529c4cd20b9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1509 microversion: 2.1 time: 0.285194 Jun 23 20:08:43.895902 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 88/181] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:43 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:44.082615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e1057815-05c7-4532-a0d6-5dcdfabe050c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:44.083867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e1057815-05c7-4532-a0d6-5dcdfabe050c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:44.086200 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:44.161804 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e1057815-05c7-4532-a0d6-5dcdfabe050c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:44.168908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e1057815-05c7-4532-a0d6-5dcdfabe050c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1094 microversion: 2.1 time: 0.090691 Jun 23 20:08:44.169790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 94/182] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:44 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:44.912145 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-97ebec4d-5955-4d93-8c9b-1ddbceb817bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:44.913148 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-97ebec4d-5955-4d93-8c9b-1ddbceb817bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:44.925330 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-97ebec4d-5955-4d93-8c9b-1ddbceb817bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:44.925786 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-97ebec4d-5955-4d93-8c9b-1ddbceb817bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:44.926868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-97ebec4d-5955-4d93-8c9b-1ddbceb817bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:44.927518 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-97ebec4d-5955-4d93-8c9b-1ddbceb817bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:45.083036 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-97ebec4d-5955-4d93-8c9b-1ddbceb817bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:45.091615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-97ebec4d-5955-4d93-8c9b-1ddbceb817bd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1509 microversion: 2.1 time: 0.184263 Jun 23 20:08:45.092658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 89/183] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:44 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:45.186641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0f35c64f-1350-468a-8785-046bdc6c0f85 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:45.187349 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0f35c64f-1350-468a-8785-046bdc6c0f85 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:45.197421 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f35c64f-1350-468a-8785-046bdc6c0f85 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:45.197872 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f35c64f-1350-468a-8785-046bdc6c0f85 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:45.198667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f35c64f-1350-468a-8785-046bdc6c0f85 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:45.199403 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f35c64f-1350-468a-8785-046bdc6c0f85 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:45.269711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0f35c64f-1350-468a-8785-046bdc6c0f85 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:45.277351 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0f35c64f-1350-468a-8785-046bdc6c0f85 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1136 microversion: 2.1 time: 0.094843 Jun 23 20:08:45.277916 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 95/184] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:45 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1136 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:46.114096 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-23fec5a6-07fc-446e-b88f-3a71706b005d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:46.114714 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-23fec5a6-07fc-446e-b88f-3a71706b005d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:46.120969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23fec5a6-07fc-446e-b88f-3a71706b005d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:46.121420 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23fec5a6-07fc-446e-b88f-3a71706b005d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:46.122184 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23fec5a6-07fc-446e-b88f-3a71706b005d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:46.122618 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23fec5a6-07fc-446e-b88f-3a71706b005d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:46.262819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-23fec5a6-07fc-446e-b88f-3a71706b005d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:46.272250 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-23fec5a6-07fc-446e-b88f-3a71706b005d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1509 microversion: 2.1 time: 0.162099 Jun 23 20:08:46.273075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 90/185] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:46 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:46.297826 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9fe10737-1ec3-4d96-a329-ccc94ddd7e50 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:46.298493 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9fe10737-1ec3-4d96-a329-ccc94ddd7e50 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:46.305268 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9fe10737-1ec3-4d96-a329-ccc94ddd7e50 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:46.305789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9fe10737-1ec3-4d96-a329-ccc94ddd7e50 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:46.306614 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9fe10737-1ec3-4d96-a329-ccc94ddd7e50 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:46.307117 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9fe10737-1ec3-4d96-a329-ccc94ddd7e50 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:46.322266 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:46.370907 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9fe10737-1ec3-4d96-a329-ccc94ddd7e50 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:46.383763 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9fe10737-1ec3-4d96-a329-ccc94ddd7e50 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1136 microversion: 2.1 time: 0.089936 Jun 23 20:08:46.384358 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 96/186] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:46 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1136 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:46.573108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0bca4d08-ed48-49b1-a8f8-df7d35e3ec7f tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90d9fd0700>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:46.622516 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0bca4d08-ed48-49b1-a8f8-df7d35e3ec7f tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cea16f6f-58d2-4ae2-ac0c-6ead6e7fd0f6" status: 200 len: 350 microversion: 2.1 time: 0.053451 Jun 23 20:08:46.623076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 91/187] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:08:46 2022] GET /compute/v2.1/os-volumes/cea16f6f-58d2-4ae2-ac0c-6ead6e7fd0f6 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:47.013981 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-867719502", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "networks": [{"uuid": "885d343b-d90c-4197-a6fc-92476b1e08bf"}]}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:47.080551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] validate_networks() for [('885d343b-d90c-4197-a6fc-92476b1e08bf', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:08:47.289777 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cb6c9b5b-482b-42a4-a321-df7898a82898 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:47.290400 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cb6c9b5b-482b-42a4-a321-df7898a82898 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:47.301502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb6c9b5b-482b-42a4-a321-df7898a82898 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:47.301502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb6c9b5b-482b-42a4-a321-df7898a82898 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:47.311889 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb6c9b5b-482b-42a4-a321-df7898a82898 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:47.314815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb6c9b5b-482b-42a4-a321-df7898a82898 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:47.543214 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cb6c9b5b-482b-42a4-a321-df7898a82898 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:47.551186 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cb6c9b5b-482b-42a4-a321-df7898a82898 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1515 microversion: 2.1 time: 0.265706 Jun 23 20:08:47.551800 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 92/188] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:47 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:47.553888 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:08:47.554332 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:08:47.554872 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:08:47.555620 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:08:47.556359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:08:47.556621 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0e1edae3-89fe-4030-a0a3-83cb1f465b7e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:47.557230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0e1edae3-89fe-4030-a0a3-83cb1f465b7e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:47.566371 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e1edae3-89fe-4030-a0a3-83cb1f465b7e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:47.572042 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e1edae3-89fe-4030-a0a3-83cb1f465b7e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:47.572042 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e1edae3-89fe-4030-a0a3-83cb1f465b7e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:47.572042 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e1edae3-89fe-4030-a0a3-83cb1f465b7e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:47.589266 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:47.589992 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:47.591042 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:47.591652 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:47.609364 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Getting quotas for project df7d693ea21441559f4db447f5414f69. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:08:47.614302 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Getting quotas for user a6a6e5f6e5f24ba89ca4895aebe158f8 and project df7d693ea21441559f4db447f5414f69. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:08:47.627305 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:08:47.629628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:08:47.648466 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0e1edae3-89fe-4030-a0a3-83cb1f465b7e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:47.656115 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0e1edae3-89fe-4030-a0a3-83cb1f465b7e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1192 microversion: 2.1 time: 0.103089 Jun 23 20:08:47.656812 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 93/189] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:47 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:47.894414 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-024fd888-2562-42f7-9811-bf3e733c8d98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884279 Jun 23 20:08:47.895260 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 97/190] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:08:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:08:47.904992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4f31cf26-a21a-4813-a6a8-785f1eea08c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:47.905627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4f31cf26-a21a-4813-a6a8-785f1eea08c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:48.019013 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4f31cf26-a21a-4813-a6a8-785f1eea08c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:48.026514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4f31cf26-a21a-4813-a6a8-785f1eea08c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1213 microversion: 2.1 time: 0.125105 Jun 23 20:08:48.027179 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 94/191] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:47 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:48.424316 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fb9f9e59-2010-4295-8216-2110d1f11e0f tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90da8058b0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:48.480327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fb9f9e59-2010-4295-8216-2110d1f11e0f tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1c4edd06-ce4f-4b31-9406-dc378fbe48aa" status: 200 len: 351 microversion: 2.1 time: 0.060390 Jun 23 20:08:48.481100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 98/192] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:08:48 2022] GET /compute/v2.1/os-volumes/1c4edd06-ce4f-4b31-9406-dc378fbe48aa => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:48.673119 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5981f5da-94eb-4253-a738-b971dd1fb037 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:48.673722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5981f5da-94eb-4253-a738-b971dd1fb037 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:48.680332 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5981f5da-94eb-4253-a738-b971dd1fb037 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:48.680797 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5981f5da-94eb-4253-a738-b971dd1fb037 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:48.681567 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5981f5da-94eb-4253-a738-b971dd1fb037 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:48.681996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5981f5da-94eb-4253-a738-b971dd1fb037 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:48.743180 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5981f5da-94eb-4253-a738-b971dd1fb037 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:48.751166 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5981f5da-94eb-4253-a738-b971dd1fb037 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1210 microversion: 2.1 time: 0.081379 Jun 23 20:08:48.751730 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 95/193] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:48 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:49.044344 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fc8d2ac9-b519-4bd9-9dc6-b086679a94eb tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:49.044949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fc8d2ac9-b519-4bd9-9dc6-b086679a94eb tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:49.103049 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fc8d2ac9-b519-4bd9-9dc6-b086679a94eb tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:49.109936 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fc8d2ac9-b519-4bd9-9dc6-b086679a94eb tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1213 microversion: 2.1 time: 0.069814 Jun 23 20:08:49.110505 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 99/194] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:49 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:49.769002 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-66ab98c4-f591-41a9-967f-b2e38e13b0d0 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:49.769610 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-66ab98c4-f591-41a9-967f-b2e38e13b0d0 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:49.775568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:49.777220 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-66ab98c4-f591-41a9-967f-b2e38e13b0d0 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:49.777757 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-66ab98c4-f591-41a9-967f-b2e38e13b0d0 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:49.778611 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-66ab98c4-f591-41a9-967f-b2e38e13b0d0 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:49.779231 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-66ab98c4-f591-41a9-967f-b2e38e13b0d0 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:49.947105 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-66ab98c4-f591-41a9-967f-b2e38e13b0d0 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:49.956097 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-66ab98c4-f591-41a9-967f-b2e38e13b0d0 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1278 microversion: 2.1 time: 0.191521 Jun 23 20:08:49.957335 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 96/195] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:49 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:49.968149 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-c4e168db-5e24-4fff-a419-2d8295545502 req-24b7cc09-67c9-44ce-b56d-d760529917a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200f25e9-8d0e-42eb-91b6-57db370e99e1", "tag": "34cb6df8-f4a2-46ac-ab20-64414d2a90b1"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:49.978839 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c4e168db-5e24-4fff-a419-2d8295545502 req-24b7cc09-67c9-44ce-b56d-d760529917a5 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:49.979282 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c4e168db-5e24-4fff-a419-2d8295545502 req-24b7cc09-67c9-44ce-b56d-d760529917a5 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:49.992152 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-c4e168db-5e24-4fff-a419-2d8295545502 req-24b7cc09-67c9-44ce-b56d-d760529917a5 service nova] Creating event network-changed:34cb6df8-f4a2-46ac-ab20-64414d2a90b1 for instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 on hv-cinder-84727 Jun 23 20:08:49.997656 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-c4e168db-5e24-4fff-a419-2d8295545502 req-24b7cc09-67c9-44ce-b56d-d760529917a5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033302 Jun 23 20:08:49.998271 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 100/196] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:50.127353 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d3fd6ab7-c0f4-4250-98a5-cba4f259ba20 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:50.128428 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d3fd6ab7-c0f4-4250-98a5-cba4f259ba20 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:50.135144 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d3fd6ab7-c0f4-4250-98a5-cba4f259ba20 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:50.146271 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d3fd6ab7-c0f4-4250-98a5-cba4f259ba20 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:50.146271 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d3fd6ab7-c0f4-4250-98a5-cba4f259ba20 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:50.146271 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d3fd6ab7-c0f4-4250-98a5-cba4f259ba20 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:50.257025 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d3fd6ab7-c0f4-4250-98a5-cba4f259ba20 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:50.264599 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d3fd6ab7-c0f4-4250-98a5-cba4f259ba20 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1265 microversion: 2.1 time: 0.142445 Jun 23 20:08:50.265170 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 97/197] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:50 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:50.502601 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-dff36060-5ad4-44d6-934e-c3bae6adfb5b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'create', calling method: .version_select at 0x7f90da805790>, body: {"keypair": {"name": "tempest-keypair-2042797951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQwo4PpRyPS/eom1JUaDfX6EiKqDNDV50EMTXA5hR2LzyS/nlKYl36k3+XNOvm4NuL2D6ijIZCPbHdVsSpSU+JlpmJ/UI8hYWexJXY9J70cmWkmh9suLPVGGerVhBqhcA=="}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:50.521784 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-dff36060-5ad4-44d6-934e-c3bae6adfb5b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Getting quotas for project bf37c9d0240b48078038d70f678a93eb. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:08:50.525847 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-dff36060-5ad4-44d6-934e-c3bae6adfb5b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Getting quotas for user f041449191c94a5ca5a38c29dd146a15 and project bf37c9d0240b48078038d70f678a93eb. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:08:50.542559 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5d2e181e-5e19-43cb-960d-c2a1563342c3 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90d9fe0310>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:50.593017 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5d2e181e-5e19-43cb-960d-c2a1563342c3 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b19753d0-9562-400a-83d8-9e2a0d3de569" status: 200 len: 351 microversion: 2.1 time: 0.054414 Jun 23 20:08:50.593911 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 98/198] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:08:50 2022] GET /compute/v2.1/os-volumes/b19753d0-9562-400a-83d8-9e2a0d3de569 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:50.604844 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c0be746d-16ce-40f7-9fce-150e8d72528c tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90d9f750d0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:50.685137 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c0be746d-16ce-40f7-9fce-150e8d72528c tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083976 Jun 23 20:08:50.695394 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 99/199] 10.222.0.44 () {58 vars in 1133 bytes} [Thu Jun 23 20:08:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:50.698080 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2d011012-c7e4-4c30-9f8b-7bc79c5d70eb tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90da123d30>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:50.761510 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-dff36060-5ad4-44d6-934e-c3bae6adfb5b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.263639 Jun 23 20:08:50.762576 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 101/200] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:08:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:08:50.795503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2d011012-c7e4-4c30-9f8b-7bc79c5d70eb tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.101084 Jun 23 20:08:50.806952 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 100/201] 10.222.0.44 () {58 vars in 1148 bytes} [Thu Jun 23 20:08:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:08:50.808383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-34fbc9f0-f091-455a-b76d-be6c31a38700 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90da816c10>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:50.895969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-34fbc9f0-f091-455a-b76d-be6c31a38700 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092031 Jun 23 20:08:50.896791 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 102/202] 10.222.0.44 () {58 vars in 1133 bytes} [Thu Jun 23 20:08:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:50.908070 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3c4f7a0a-fa54-4f2e-bae7-f64d399ab980 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90d9f75af0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:50.973826 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-89b8aacb-aafa-4cac-a8ee-60216bac12ba tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:50.974847 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-89b8aacb-aafa-4cac-a8ee-60216bac12ba tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:50.983682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-89b8aacb-aafa-4cac-a8ee-60216bac12ba tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:50.984128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-89b8aacb-aafa-4cac-a8ee-60216bac12ba tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:50.986061 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-89b8aacb-aafa-4cac-a8ee-60216bac12ba tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:50.986653 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-89b8aacb-aafa-4cac-a8ee-60216bac12ba tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:51.026043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3c4f7a0a-fa54-4f2e-bae7-f64d399ab980 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.122329 Jun 23 20:08:51.027833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 101/203] 10.222.0.44 () {58 vars in 1166 bytes} [Thu Jun 23 20:08:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:51.042175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a2a8406f-6cef-4260-a412-f7348b3fe35e tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90da163ee0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:51.138788 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a2a8406f-6cef-4260-a412-f7348b3fe35e tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.103402 Jun 23 20:08:51.140537 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 102/204] 10.222.0.44 () {58 vars in 1169 bytes} [Thu Jun 23 20:08:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:08:51.151961 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2084dad4-5aee-4208-ab3a-8640be72ac77 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90d9fd0700>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:51.269799 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2084dad4-5aee-4208-ab3a-8640be72ac77 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.121587 Jun 23 20:08:51.276164 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 103/205] 10.222.0.44 () {58 vars in 1154 bytes} [Thu Jun 23 20:08:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:51.286119 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-27dcd10d-8256-4b27-b970-5edb7f7ded41 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:51.286816 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-27dcd10d-8256-4b27-b970-5edb7f7ded41 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:51.293296 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27dcd10d-8256-4b27-b970-5edb7f7ded41 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:51.293821 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27dcd10d-8256-4b27-b970-5edb7f7ded41 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:51.294806 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27dcd10d-8256-4b27-b970-5edb7f7ded41 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:51.295255 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27dcd10d-8256-4b27-b970-5edb7f7ded41 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:51.317952 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-89b8aacb-aafa-4cac-a8ee-60216bac12ba tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:51.327111 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-89b8aacb-aafa-4cac-a8ee-60216bac12ba tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1278 microversion: 2.1 time: 0.358541 Jun 23 20:08:51.327788 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 103/206] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:50 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1278 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:51.333841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-34878d89-3607-4665-89ca-8cdcdd1f0d5b tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90da816e50>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:51.399351 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-27dcd10d-8256-4b27-b970-5edb7f7ded41 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:51.406822 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-27dcd10d-8256-4b27-b970-5edb7f7ded41 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1283 microversion: 2.1 time: 0.124697 Jun 23 20:08:51.407892 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 104/207] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:51 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1283 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:51.428120 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-34878d89-3607-4665-89ca-8cdcdd1f0d5b tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099140 Jun 23 20:08:51.428714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 104/208] 10.222.0.44 () {58 vars in 1187 bytes} [Thu Jun 23 20:08:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:51.440607 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9db76805-0cf4-4d18-bde5-09b2fc47f404 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] Calling method '.version_select at 0x7f90da14ae50>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:51.554517 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9db76805-0cf4-4d18-bde5-09b2fc47f404 tempest-VolumesTestJSON-624232647 tempest-VolumesTestJSON-624232647-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.111887 Jun 23 20:08:51.554517 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 105/209] 10.222.0.44 () {58 vars in 1154 bytes} [Thu Jun 23 20:08:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:52.344708 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9703a940-d400-4840-8b18-9bedb0b84033 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:52.345320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9703a940-d400-4840-8b18-9bedb0b84033 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:52.351429 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9703a940-d400-4840-8b18-9bedb0b84033 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:52.351864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9703a940-d400-4840-8b18-9bedb0b84033 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:52.352724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9703a940-d400-4840-8b18-9bedb0b84033 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:52.353164 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9703a940-d400-4840-8b18-9bedb0b84033 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:52.426904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a60783aa-f85d-4d23-b9ce-053824155c59 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:52.428082 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a60783aa-f85d-4d23-b9ce-053824155c59 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:52.434827 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a60783aa-f85d-4d23-b9ce-053824155c59 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:52.435442 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a60783aa-f85d-4d23-b9ce-053824155c59 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:52.436390 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a60783aa-f85d-4d23-b9ce-053824155c59 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:52.436960 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a60783aa-f85d-4d23-b9ce-053824155c59 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:52.607259 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9703a940-d400-4840-8b18-9bedb0b84033 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:52.618113 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9703a940-d400-4840-8b18-9bedb0b84033 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.277205 Jun 23 20:08:52.619784 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 105/210] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:52 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:52.717006 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a60783aa-f85d-4d23-b9ce-053824155c59 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:52.725780 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a60783aa-f85d-4d23-b9ce-053824155c59 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1313 microversion: 2.1 time: 0.305142 Jun 23 20:08:52.726436 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 106/211] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:52 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:52.854828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-13d9fe3e-8f56-4a92-966e-765a211afd9f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:52.855718 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-13d9fe3e-8f56-4a92-966e-765a211afd9f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:52.862183 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13d9fe3e-8f56-4a92-966e-765a211afd9f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:52.862754 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13d9fe3e-8f56-4a92-966e-765a211afd9f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:52.864467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13d9fe3e-8f56-4a92-966e-765a211afd9f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:52.864467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13d9fe3e-8f56-4a92-966e-765a211afd9f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:52.909542 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-13d9fe3e-8f56-4a92-966e-765a211afd9f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/ips" status: 200 len: 149 microversion: 2.1 time: 0.059872 Jun 23 20:08:52.911050 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 106/212] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:08:52 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:53.483387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-8f019178-e9c4-4df7-8ed8-10099bc96dd1 req-1d144852-0286-46ad-a844-e9f45786f519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc58eeec-d1c2-4007-8c87-b60f15e48c34", "tag": "ecf3dc34-4797-4907-bc20-27a9826c848a"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:53.496807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8f019178-e9c4-4df7-8ed8-10099bc96dd1 req-1d144852-0286-46ad-a844-e9f45786f519 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:53.497240 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8f019178-e9c4-4df7-8ed8-10099bc96dd1 req-1d144852-0286-46ad-a844-e9f45786f519 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:53.502633 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:53.510147 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-8f019178-e9c4-4df7-8ed8-10099bc96dd1 req-1d144852-0286-46ad-a844-e9f45786f519 service nova] Creating event network-changed:ecf3dc34-4797-4907-bc20-27a9826c848a for instance fc58eeec-d1c2-4007-8c87-b60f15e48c34 on hv-cinder-84727 Jun 23 20:08:53.515886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-8f019178-e9c4-4df7-8ed8-10099bc96dd1 req-1d144852-0286-46ad-a844-e9f45786f519 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038810 Jun 23 20:08:53.516123 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 107/213] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:08:53.634903 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9f4b1e8b-c9b1-4270-9845-4cde9b0f05dd tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:53.635638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9f4b1e8b-c9b1-4270-9845-4cde9b0f05dd tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:53.641820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f4b1e8b-c9b1-4270-9845-4cde9b0f05dd tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:53.642275 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f4b1e8b-c9b1-4270-9845-4cde9b0f05dd tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:53.643124 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f4b1e8b-c9b1-4270-9845-4cde9b0f05dd tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:53.643562 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f4b1e8b-c9b1-4270-9845-4cde9b0f05dd tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:53.751917 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-22f4c547-04c5-4f13-83e3-f1bd44a55917 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:53.753062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-22f4c547-04c5-4f13-83e3-f1bd44a55917 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:53.767673 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-22f4c547-04c5-4f13-83e3-f1bd44a55917 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:53.768468 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-22f4c547-04c5-4f13-83e3-f1bd44a55917 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:53.769662 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-22f4c547-04c5-4f13-83e3-f1bd44a55917 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:53.770314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-22f4c547-04c5-4f13-83e3-f1bd44a55917 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:53.930241 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9f4b1e8b-c9b1-4270-9845-4cde9b0f05dd tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:53.938242 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9f4b1e8b-c9b1-4270-9845-4cde9b0f05dd tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.307129 Jun 23 20:08:53.938819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 107/214] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:53 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:53.943961 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-89689757", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "080ae0a2-412d-4942-8b59-3cac39c039b1"}], "security_groups": [{"name": "tempest-securitygroup--248214616"}], "key_name": "tempest-keypair-2042797951", "user_data": "}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:54.048191 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-22f4c547-04c5-4f13-83e3-f1bd44a55917 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:54.061955 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-22f4c547-04c5-4f13-83e3-f1bd44a55917 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1313 microversion: 2.1 time: 0.316598 Jun 23 20:08:54.063802 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 108/215] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:53 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:54.080119 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] validate_networks() for [('080ae0a2-412d-4942-8b59-3cac39c039b1', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:08:54.893522 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b3136ea5-d69d-4b6e-85a9-cac245f64490 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cd0e6cd-7c2a-4f52-8938-7468399ad9f4"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:54.894361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b3136ea5-d69d-4b6e-85a9-cac245f64490 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:54.902432 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b3136ea5-d69d-4b6e-85a9-cac245f64490 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:54.903111 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b3136ea5-d69d-4b6e-85a9-cac245f64490 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:54.904438 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b3136ea5-d69d-4b6e-85a9-cac245f64490 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:54.905167 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b3136ea5-d69d-4b6e-85a9-cac245f64490 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:54.958435 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:08:54.958907 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:08:54.959328 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:08:54.959778 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:08:54.960383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:08:54.970489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:54.971104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:54.972039 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:54.972668 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:54.996072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Getting quotas for project bf37c9d0240b48078038d70f678a93eb. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:08:54.996647 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Getting quotas for user f041449191c94a5ca5a38c29dd146a15 and project bf37c9d0240b48078038d70f678a93eb. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:08:55.010564 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:08:55.012883 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:08:55.184328 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ff692101-7532-40de-8109-86dccf3fe70d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.244386 Jun 23 20:08:55.184911 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 108/216] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:08:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:08:55.190075 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-927da73f-ea46-43fa-9650-4ccf29e529be tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:55.190637 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-927da73f-ea46-43fa-9650-4ccf29e529be tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:55.196931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-927da73f-ea46-43fa-9650-4ccf29e529be tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:55.197385 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-927da73f-ea46-43fa-9650-4ccf29e529be tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:55.198143 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-927da73f-ea46-43fa-9650-4ccf29e529be tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:55.198579 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-927da73f-ea46-43fa-9650-4ccf29e529be tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:55.222783 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-927da73f-ea46-43fa-9650-4ccf29e529be tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/ips" status: 200 len: 153 microversion: 2.20 time: 0.036764 Jun 23 20:08:55.229489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 109/217] 10.222.0.44 () {60 vars in 1288 bytes} [Thu Jun 23 20:08:55 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:08:55.229489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6df5e701-6cb0-462e-969b-018a4651b99e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:55.229489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6df5e701-6cb0-462e-969b-018a4651b99e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:55.236066 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6df5e701-6cb0-462e-969b-018a4651b99e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:55.236530 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6df5e701-6cb0-462e-969b-018a4651b99e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:55.237453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6df5e701-6cb0-462e-969b-018a4651b99e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:55.238037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6df5e701-6cb0-462e-969b-018a4651b99e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:55.401001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-6df5e701-6cb0-462e-969b-018a4651b99e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:55.409092 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6df5e701-6cb0-462e-969b-018a4651b99e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.184388 Jun 23 20:08:55.409656 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 110/218] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:55 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:55.413996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9861a536-4eb8-4993-bca5-65df7f34c262 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:55.414830 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9861a536-4eb8-4993-bca5-65df7f34c262 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:55.420657 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9861a536-4eb8-4993-bca5-65df7f34c262 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:55.421103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9861a536-4eb8-4993-bca5-65df7f34c262 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:55.423164 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9861a536-4eb8-4993-bca5-65df7f34c262 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:55.423164 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9861a536-4eb8-4993-bca5-65df7f34c262 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:55.555356 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9861a536-4eb8-4993-bca5-65df7f34c262 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:55.562744 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9861a536-4eb8-4993-bca5-65df7f34c262 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1313 microversion: 2.1 time: 0.152146 Jun 23 20:08:55.563489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 111/219] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:55 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:55.568016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-65fb3673-bd9c-4d2f-9daf-f379a62aeb7f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:55.568773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-65fb3673-bd9c-4d2f-9daf-f379a62aeb7f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:55.628125 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-65fb3673-bd9c-4d2f-9daf-f379a62aeb7f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:55.633486 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-65fb3673-bd9c-4d2f-9daf-f379a62aeb7f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1244 microversion: 2.1 time: 0.068905 Jun 23 20:08:55.634140 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 112/220] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:55 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:56.426359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ad3c780b-57af-436c-a97a-2b1b99dc190d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:56.426821 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ad3c780b-57af-436c-a97a-2b1b99dc190d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:56.433872 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad3c780b-57af-436c-a97a-2b1b99dc190d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:56.434808 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad3c780b-57af-436c-a97a-2b1b99dc190d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:56.436123 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad3c780b-57af-436c-a97a-2b1b99dc190d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:56.437028 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad3c780b-57af-436c-a97a-2b1b99dc190d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:56.652553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ad3c780b-57af-436c-a97a-2b1b99dc190d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:56.660248 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ad3c780b-57af-436c-a97a-2b1b99dc190d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.238050 Jun 23 20:08:56.664895 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 113/221] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:56 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:56.670110 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-acc2bdd7-db00-497b-81a8-4d394f746173 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:56.670715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-acc2bdd7-db00-497b-81a8-4d394f746173 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:56.677172 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-acc2bdd7-db00-497b-81a8-4d394f746173 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:56.677602 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-acc2bdd7-db00-497b-81a8-4d394f746173 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:56.678359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-acc2bdd7-db00-497b-81a8-4d394f746173 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:56.678794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-acc2bdd7-db00-497b-81a8-4d394f746173 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:56.823910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-acc2bdd7-db00-497b-81a8-4d394f746173 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:56.831752 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-acc2bdd7-db00-497b-81a8-4d394f746173 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1313 microversion: 2.1 time: 0.165218 Jun 23 20:08:56.832350 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 114/222] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:56 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:56.837128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5c9b6938-c86e-4b03-901e-4fd01a10e674 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:56.837728 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5c9b6938-c86e-4b03-901e-4fd01a10e674 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:56.844135 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5c9b6938-c86e-4b03-901e-4fd01a10e674 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:56.844633 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5c9b6938-c86e-4b03-901e-4fd01a10e674 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:56.845386 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5c9b6938-c86e-4b03-901e-4fd01a10e674 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:56.846338 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5c9b6938-c86e-4b03-901e-4fd01a10e674 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:56.928922 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5c9b6938-c86e-4b03-901e-4fd01a10e674 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:56.930666 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b3136ea5-d69d-4b6e-85a9-cac245f64490 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.042012 Jun 23 20:08:56.933663 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 109/223] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:08:54 2022] POST /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments => generated 194 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:08:56.944114 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5c9b6938-c86e-4b03-901e-4fd01a10e674 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1240 microversion: 2.1 time: 0.109871 Jun 23 20:08:56.945127 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 115/224] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:56 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:57.678857 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4619b0b4-3f5c-4a8c-8e9a-e0e4812298b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:57.679552 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4619b0b4-3f5c-4a8c-8e9a-e0e4812298b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:57.685966 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4619b0b4-3f5c-4a8c-8e9a-e0e4812298b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:57.686838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4619b0b4-3f5c-4a8c-8e9a-e0e4812298b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:57.687389 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4619b0b4-3f5c-4a8c-8e9a-e0e4812298b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:57.687821 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4619b0b4-3f5c-4a8c-8e9a-e0e4812298b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:57.847485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4619b0b4-3f5c-4a8c-8e9a-e0e4812298b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:57.849483 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2e2fc480-e520-427c-950a-9177f4cd5184 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:57.850962 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2e2fc480-e520-427c-950a-9177f4cd5184 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:57.858977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2e2fc480-e520-427c-950a-9177f4cd5184 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:57.859165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4619b0b4-3f5c-4a8c-8e9a-e0e4812298b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.185376 Jun 23 20:08:57.859406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2e2fc480-e520-427c-950a-9177f4cd5184 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:57.860166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2e2fc480-e520-427c-950a-9177f4cd5184 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:57.860778 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2e2fc480-e520-427c-950a-9177f4cd5184 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:57.869666 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 110/225] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:57 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:57.965472 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-55fbb3cd-25de-47d7-8d4a-3e964e238e3c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:57.966842 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-55fbb3cd-25de-47d7-8d4a-3e964e238e3c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:57.975544 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55fbb3cd-25de-47d7-8d4a-3e964e238e3c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:57.976099 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55fbb3cd-25de-47d7-8d4a-3e964e238e3c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:57.976927 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55fbb3cd-25de-47d7-8d4a-3e964e238e3c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:57.977874 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-55fbb3cd-25de-47d7-8d4a-3e964e238e3c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:58.029577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:58.044213 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2e2fc480-e520-427c-950a-9177f4cd5184 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:58.052687 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2e2fc480-e520-427c-950a-9177f4cd5184 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1313 microversion: 2.1 time: 0.207107 Jun 23 20:08:58.053584 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 116/226] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:57 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:58.064924 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-55fbb3cd-25de-47d7-8d4a-3e964e238e3c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:58.076120 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-55fbb3cd-25de-47d7-8d4a-3e964e238e3c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1304 microversion: 2.1 time: 0.117676 Jun 23 20:08:58.076723 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 111/227] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:57 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:08:58.692628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-96820045-efa9-49b7-8d06-6fcf6dcb57c4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:08:58.693162 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-96820045-efa9-49b7-8d06-6fcf6dcb57c4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:58.699883 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-96820045-efa9-49b7-8d06-6fcf6dcb57c4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:58.700358 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-96820045-efa9-49b7-8d06-6fcf6dcb57c4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:58.701109 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-96820045-efa9-49b7-8d06-6fcf6dcb57c4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:58.701695 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-96820045-efa9-49b7-8d06-6fcf6dcb57c4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:58.725854 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-96820045-efa9-49b7-8d06-6fcf6dcb57c4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lazy-loading 'flavor' on Instance uuid 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:08:58.879981 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fc74dc8d-eba1-4eb8-a396-9639dfd44756 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:58.880812 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fc74dc8d-eba1-4eb8-a396-9639dfd44756 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:58.892446 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fc74dc8d-eba1-4eb8-a396-9639dfd44756 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:58.893046 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fc74dc8d-eba1-4eb8-a396-9639dfd44756 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:58.906293 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fc74dc8d-eba1-4eb8-a396-9639dfd44756 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:58.907671 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fc74dc8d-eba1-4eb8-a396-9639dfd44756 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:59.345701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fc74dc8d-eba1-4eb8-a396-9639dfd44756 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:59.358880 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fc74dc8d-eba1-4eb8-a396-9639dfd44756 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.486070 Jun 23 20:08:59.359393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 112/228] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:58 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:59.369237 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2970c11e-9154-4e6f-ab94-9ce9efd33f1a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:59.370152 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2970c11e-9154-4e6f-ab94-9ce9efd33f1a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:59.376399 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2970c11e-9154-4e6f-ab94-9ce9efd33f1a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:59.377119 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2970c11e-9154-4e6f-ab94-9ce9efd33f1a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:59.378030 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2970c11e-9154-4e6f-ab94-9ce9efd33f1a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:59.380045 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2970c11e-9154-4e6f-ab94-9ce9efd33f1a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:59.477511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-96820045-efa9-49b7-8d06-6fcf6dcb57c4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/action" status: 202 len: 0 microversion: 2.20 time: 0.789336 Jun 23 20:08:59.478564 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 117/229] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jun 23 20:08:58 2022] POST /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:08:59.489511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-28b24a37-4ebe-4b42-b77f-ffd675a24fe4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:59.495571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-28b24a37-4ebe-4b42-b77f-ffd675a24fe4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:59.500110 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28b24a37-4ebe-4b42-b77f-ffd675a24fe4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:59.500764 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28b24a37-4ebe-4b42-b77f-ffd675a24fe4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:59.504476 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28b24a37-4ebe-4b42-b77f-ffd675a24fe4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:59.505243 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28b24a37-4ebe-4b42-b77f-ffd675a24fe4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:59.651034 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-28b24a37-4ebe-4b42-b77f-ffd675a24fe4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:59.664619 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-28b24a37-4ebe-4b42-b77f-ffd675a24fe4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1302 microversion: 2.1 time: 0.184585 Jun 23 20:08:59.666153 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 118/230] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:59 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1302 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:59.671489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:08:59.672982 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:08:59.681352 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:59.681810 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:59.683670 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:08:59.684185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:08:59.685484 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2970c11e-9154-4e6f-ab94-9ce9efd33f1a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:59.699200 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2970c11e-9154-4e6f-ab94-9ce9efd33f1a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1313 microversion: 2.1 time: 0.337399 Jun 23 20:08:59.699782 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 113/231] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:08:59 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:08:59.708216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:08:59.933735 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:59.946318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:59.949460 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:08:59.950349 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4176702d-72cb-4407-b12d-5209208db372 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.282658 Jun 23 20:08:59.951726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 119/232] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:08:59 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:00.384135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4843bd74-f651-461f-bc74-14a990802e9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:00.385503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4843bd74-f651-461f-bc74-14a990802e9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:00.395487 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4843bd74-f651-461f-bc74-14a990802e9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:00.399114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4843bd74-f651-461f-bc74-14a990802e9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:00.399114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4843bd74-f651-461f-bc74-14a990802e9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:00.399114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4843bd74-f651-461f-bc74-14a990802e9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:00.604257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-2297359e-a693-4127-864d-0fd340856fcc req-a51e324f-e245-4a6f-ad1e-d9583b6e4e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc58eeec-d1c2-4007-8c87-b60f15e48c34", "name": "network-vif-plugged", "status": "completed", "tag": "ecf3dc34-4797-4907-bc20-27a9826c848a"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:00.616158 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-2297359e-a693-4127-864d-0fd340856fcc req-a51e324f-e245-4a6f-ad1e-d9583b6e4e5c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:00.616642 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-2297359e-a693-4127-864d-0fd340856fcc req-a51e324f-e245-4a6f-ad1e-d9583b6e4e5c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:00.636628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-2297359e-a693-4127-864d-0fd340856fcc req-a51e324f-e245-4a6f-ad1e-d9583b6e4e5c service nova] Creating event network-vif-plugged:ecf3dc34-4797-4907-bc20-27a9826c848a for instance fc58eeec-d1c2-4007-8c87-b60f15e48c34 on hv-cinder-84727 Jun 23 20:09:00.639640 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-2297359e-a693-4127-864d-0fd340856fcc req-a51e324f-e245-4a6f-ad1e-d9583b6e4e5c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042280 Jun 23 20:09:00.640757 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 120/233] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:09:00.651625 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4843bd74-f651-461f-bc74-14a990802e9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:00.669552 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4843bd74-f651-461f-bc74-14a990802e9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.296952 Jun 23 20:09:00.685249 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 114/234] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:00 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:00.689921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-af496a78-9377-49b6-858f-d907f5118d90 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:00.691146 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-af496a78-9377-49b6-858f-d907f5118d90 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:00.706112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-af496a78-9377-49b6-858f-d907f5118d90 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:00.707570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-af496a78-9377-49b6-858f-d907f5118d90 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:00.708656 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-af496a78-9377-49b6-858f-d907f5118d90 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:00.709286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-af496a78-9377-49b6-858f-d907f5118d90 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:00.718332 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9564e012-902e-44ae-a21b-aa6bdd2b94c7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:00.720327 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9564e012-902e-44ae-a21b-aa6bdd2b94c7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:00.733069 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9564e012-902e-44ae-a21b-aa6bdd2b94c7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:00.747794 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9564e012-902e-44ae-a21b-aa6bdd2b94c7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:00.748822 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9564e012-902e-44ae-a21b-aa6bdd2b94c7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:00.751167 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9564e012-902e-44ae-a21b-aa6bdd2b94c7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:01.282969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9564e012-902e-44ae-a21b-aa6bdd2b94c7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:01.287349 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-af496a78-9377-49b6-858f-d907f5118d90 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:01.292175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9564e012-902e-44ae-a21b-aa6bdd2b94c7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1313 microversion: 2.1 time: 0.579181 Jun 23 20:09:01.301211 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-af496a78-9377-49b6-858f-d907f5118d90 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.616589 Jun 23 20:09:01.310530 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 121/235] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:00 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:01.312397 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 115/236] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:00 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:01.316806 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:01.317420 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:01.348228 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:01.348709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:01.349484 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:01.349919 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:01.646598 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-0022dcd3-4077-4f3c-9c8d-9a11bf49c0e5 req-ee4b2de8-1dec-42e9-8a47-09796aafeb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5de1ee-6219-48dc-af73-d21b440c9122", "tag": "27c60352-48b3-4e75-b043-6c1f57dcdca4"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:01.663789 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-0022dcd3-4077-4f3c-9c8d-9a11bf49c0e5 req-ee4b2de8-1dec-42e9-8a47-09796aafeb02 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:01.664536 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-0022dcd3-4077-4f3c-9c8d-9a11bf49c0e5 req-ee4b2de8-1dec-42e9-8a47-09796aafeb02 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:01.681471 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-0022dcd3-4077-4f3c-9c8d-9a11bf49c0e5 req-ee4b2de8-1dec-42e9-8a47-09796aafeb02 service nova] Creating event network-changed:27c60352-48b3-4e75-b043-6c1f57dcdca4 for instance 6e5de1ee-6219-48dc-af73-d21b440c9122 on hv-cinder-84727 Jun 23 20:09:01.687686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-0022dcd3-4077-4f3c-9c8d-9a11bf49c0e5 req-ee4b2de8-1dec-42e9-8a47-09796aafeb02 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045419 Jun 23 20:09:01.688878 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 116/237] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:09:01.698249 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ec8c7777-8960-4060-9df1-87c3fe777814 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:01.699947 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ec8c7777-8960-4060-9df1-87c3fe777814 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:01.709650 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ec8c7777-8960-4060-9df1-87c3fe777814 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:01.711021 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ec8c7777-8960-4060-9df1-87c3fe777814 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:01.712630 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ec8c7777-8960-4060-9df1-87c3fe777814 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:01.713189 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ec8c7777-8960-4060-9df1-87c3fe777814 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:01.723501 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:01.740878 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:01.743018 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:01.744757 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c956acd7-4b0f-4a2a-a660-650c810b5ec2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.441857 Jun 23 20:09:01.746047 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 122/238] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:01 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:01.877986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ec8c7777-8960-4060-9df1-87c3fe777814 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:01.900253 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ec8c7777-8960-4060-9df1-87c3fe777814 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.198020 Jun 23 20:09:01.900253 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 117/239] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:01 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:02.320142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-019c2411-3ad2-4a57-b4de-1c3cccf481b2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:02.322440 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-16e3ea98-cbc9-4e99-9e76-188e7582f531 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:02.322440 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-16e3ea98-cbc9-4e99-9e76-188e7582f531 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:02.323656 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-019c2411-3ad2-4a57-b4de-1c3cccf481b2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:02.341747 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-16e3ea98-cbc9-4e99-9e76-188e7582f531 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:02.342206 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-16e3ea98-cbc9-4e99-9e76-188e7582f531 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:02.343032 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-16e3ea98-cbc9-4e99-9e76-188e7582f531 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:02.343476 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-16e3ea98-cbc9-4e99-9e76-188e7582f531 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:02.348580 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-019c2411-3ad2-4a57-b4de-1c3cccf481b2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:02.348580 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-019c2411-3ad2-4a57-b4de-1c3cccf481b2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:02.348580 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-019c2411-3ad2-4a57-b4de-1c3cccf481b2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:02.351488 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-019c2411-3ad2-4a57-b4de-1c3cccf481b2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:02.667520 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-019c2411-3ad2-4a57-b4de-1c3cccf481b2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:02.684409 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-16e3ea98-cbc9-4e99-9e76-188e7582f531 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:02.694734 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-019c2411-3ad2-4a57-b4de-1c3cccf481b2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1313 microversion: 2.1 time: 0.386734 Jun 23 20:09:02.697477 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 123/240] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:02 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:02.709159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-16e3ea98-cbc9-4e99-9e76-188e7582f531 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.395402 Jun 23 20:09:02.710331 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 118/241] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:02 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:02.765943 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:02.767179 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:02.774209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:02.776322 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:02.776780 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:02.777720 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:02.778302 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:02.833122 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-29b0b515-0dd8-4c9e-b2d2-29fcd0e10752 req-5fc46ee4-61d8-417c-9e1b-0d3bdad030b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200f25e9-8d0e-42eb-91b6-57db370e99e1", "name": "network-vif-plugged", "status": "completed", "tag": "34cb6df8-f4a2-46ac-ab20-64414d2a90b1"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:02.842246 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-29b0b515-0dd8-4c9e-b2d2-29fcd0e10752 req-5fc46ee4-61d8-417c-9e1b-0d3bdad030b2 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:02.842862 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-29b0b515-0dd8-4c9e-b2d2-29fcd0e10752 req-5fc46ee4-61d8-417c-9e1b-0d3bdad030b2 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:02.855517 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-29b0b515-0dd8-4c9e-b2d2-29fcd0e10752 req-5fc46ee4-61d8-417c-9e1b-0d3bdad030b2 service nova] Creating event network-vif-plugged:34cb6df8-f4a2-46ac-ab20-64414d2a90b1 for instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 on hv-cinder-84727 Jun 23 20:09:02.861142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-29b0b515-0dd8-4c9e-b2d2-29fcd0e10752 req-5fc46ee4-61d8-417c-9e1b-0d3bdad030b2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031770 Jun 23 20:09:02.862367 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 119/242] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:02.914658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f76e06e0-5bce-42f2-8a22-9f6b336790b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:02.915360 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f76e06e0-5bce-42f2-8a22-9f6b336790b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:02.922250 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f76e06e0-5bce-42f2-8a22-9f6b336790b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:02.922755 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f76e06e0-5bce-42f2-8a22-9f6b336790b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:02.923478 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f76e06e0-5bce-42f2-8a22-9f6b336790b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:02.923914 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f76e06e0-5bce-42f2-8a22-9f6b336790b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:02.985765 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:02.994682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:02.996435 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:02.997881 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-99ef53a1-f632-477c-9f79-84771952f1ab tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.237381 Jun 23 20:09:03.008829 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 124/243] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:02 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:03.184986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f76e06e0-5bce-42f2-8a22-9f6b336790b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:03.194866 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f76e06e0-5bce-42f2-8a22-9f6b336790b5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.285201 Jun 23 20:09:03.278763 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 120/244] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:02 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:03.718612 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bf43fcd8-c1d1-4bd3-a53d-ad37d5978603 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:03.719341 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bf43fcd8-c1d1-4bd3-a53d-ad37d5978603 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:03.730184 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bf43fcd8-c1d1-4bd3-a53d-ad37d5978603 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:03.731103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bf43fcd8-c1d1-4bd3-a53d-ad37d5978603 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:03.734590 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-faecb699-c583-4e5b-b50e-237309a411c7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:03.735198 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-faecb699-c583-4e5b-b50e-237309a411c7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:03.735856 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bf43fcd8-c1d1-4bd3-a53d-ad37d5978603 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:03.737578 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bf43fcd8-c1d1-4bd3-a53d-ad37d5978603 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:03.747233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-faecb699-c583-4e5b-b50e-237309a411c7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:03.747680 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-faecb699-c583-4e5b-b50e-237309a411c7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:03.748741 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-faecb699-c583-4e5b-b50e-237309a411c7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:03.749574 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-faecb699-c583-4e5b-b50e-237309a411c7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:04.034231 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-faecb699-c583-4e5b-b50e-237309a411c7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:04.043187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-faecb699-c583-4e5b-b50e-237309a411c7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.312630 Jun 23 20:09:04.047351 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-bf43fcd8-c1d1-4bd3-a53d-ad37d5978603 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:04.048822 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 121/245] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:03 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:04.055690 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:04.056317 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:04.058437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bf43fcd8-c1d1-4bd3-a53d-ad37d5978603 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1498 microversion: 2.1 time: 0.348335 Jun 23 20:09:04.063318 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:04.063772 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:04.064585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:04.064864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 125/246] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:03 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1498 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:04.065088 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:04.284973 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d79c881b-2fff-4f77-8d16-6c006b81c536 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:04.285894 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d79c881b-2fff-4f77-8d16-6c006b81c536 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:04.287203 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:04.293964 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d79c881b-2fff-4f77-8d16-6c006b81c536 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:04.295521 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d79c881b-2fff-4f77-8d16-6c006b81c536 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:04.296636 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d79c881b-2fff-4f77-8d16-6c006b81c536 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:04.297988 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d79c881b-2fff-4f77-8d16-6c006b81c536 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:04.300999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:04.302888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:04.304976 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be9b2852-1b3d-4121-873e-7c9ad5a3b962 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.253636 Jun 23 20:09:04.305551 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 122/247] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:04 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:04.463217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d79c881b-2fff-4f77-8d16-6c006b81c536 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:04.470551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d79c881b-2fff-4f77-8d16-6c006b81c536 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.191209 Jun 23 20:09:04.471272 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 126/248] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:04 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:05.058743 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5adc7812-910e-496e-96c5-fac1947ca668 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:05.059347 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5adc7812-910e-496e-96c5-fac1947ca668 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:05.066441 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5adc7812-910e-496e-96c5-fac1947ca668 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:05.066881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5adc7812-910e-496e-96c5-fac1947ca668 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:05.067653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5adc7812-910e-496e-96c5-fac1947ca668 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:05.068081 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5adc7812-910e-496e-96c5-fac1947ca668 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:05.202151 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5adc7812-910e-496e-96c5-fac1947ca668 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:05.209165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5adc7812-910e-496e-96c5-fac1947ca668 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.154161 Jun 23 20:09:05.209733 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 123/249] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:05 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:05.324325 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:05.324937 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:05.326780 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=6 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:05.332195 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:05.332668 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:05.333408 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:05.334029 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:05.465784 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:05.473780 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:05.479372 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:05.479372 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ff153905-ebc7-4cb4-96f9-b02e4179272c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.156212 Jun 23 20:09:05.479372 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 127/250] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:05 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:05.486776 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1f211eb1-15f7-4794-b46a-631dd7d2aef9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:05.488079 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1f211eb1-15f7-4794-b46a-631dd7d2aef9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:05.494668 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f211eb1-15f7-4794-b46a-631dd7d2aef9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:05.495126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f211eb1-15f7-4794-b46a-631dd7d2aef9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:05.495890 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f211eb1-15f7-4794-b46a-631dd7d2aef9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:05.496352 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f211eb1-15f7-4794-b46a-631dd7d2aef9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:05.514867 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:05.629974 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1f211eb1-15f7-4794-b46a-631dd7d2aef9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:05.637377 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1f211eb1-15f7-4794-b46a-631dd7d2aef9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.154405 Jun 23 20:09:05.637937 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 124/251] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:05 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:06.226263 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-39d154e9-3a85-4d2d-a91a-ea6541823a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:06.226864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-39d154e9-3a85-4d2d-a91a-ea6541823a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:06.229965 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=28 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:06.234259 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-39d154e9-3a85-4d2d-a91a-ea6541823a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:06.234863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-39d154e9-3a85-4d2d-a91a-ea6541823a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:06.235616 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-39d154e9-3a85-4d2d-a91a-ea6541823a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:06.236048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-39d154e9-3a85-4d2d-a91a-ea6541823a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:06.375187 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-39d154e9-3a85-4d2d-a91a-ea6541823a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:06.382820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-39d154e9-3a85-4d2d-a91a-ea6541823a1c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.160345 Jun 23 20:09:06.383408 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 128/252] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:06 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:06.495204 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:06.495817 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:06.504530 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:06.504991 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:06.505746 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:06.506175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:06.635679 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:06.643488 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:06.645604 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:06.646788 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d0c1456d-e327-4af2-a487-aa34d201d0aa tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.155889 Jun 23 20:09:06.647347 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 125/253] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:06 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:06.653860 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b6a909bf-342f-4c14-8d9f-5d979ba4b2c9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:06.654501 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b6a909bf-342f-4c14-8d9f-5d979ba4b2c9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:06.665072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b6a909bf-342f-4c14-8d9f-5d979ba4b2c9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:06.665072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b6a909bf-342f-4c14-8d9f-5d979ba4b2c9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:06.665072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b6a909bf-342f-4c14-8d9f-5d979ba4b2c9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:06.665072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b6a909bf-342f-4c14-8d9f-5d979ba4b2c9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:06.791739 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b6a909bf-342f-4c14-8d9f-5d979ba4b2c9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:06.799130 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b6a909bf-342f-4c14-8d9f-5d979ba4b2c9 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.149067 Jun 23 20:09:06.799693 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 129/254] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:06 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:07.398892 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-62a9b8dd-66e0-4b51-b6ca-6ad5c2a8870c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:07.403386 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-62a9b8dd-66e0-4b51-b6ca-6ad5c2a8870c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:07.406239 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62a9b8dd-66e0-4b51-b6ca-6ad5c2a8870c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:07.406689 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62a9b8dd-66e0-4b51-b6ca-6ad5c2a8870c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:07.407431 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62a9b8dd-66e0-4b51-b6ca-6ad5c2a8870c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:07.407859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-62a9b8dd-66e0-4b51-b6ca-6ad5c2a8870c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:07.541306 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-62a9b8dd-66e0-4b51-b6ca-6ad5c2a8870c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:07.547257 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-62a9b8dd-66e0-4b51-b6ca-6ad5c2a8870c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.152284 Jun 23 20:09:07.547823 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 126/255] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:07 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:07.665582 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:07.666191 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:07.672256 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:07.672725 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:07.673473 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:07.673932 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:07.815811 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-95ac5c57-0ad4-4bd1-acd3-76841142bfb5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:07.816824 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-95ac5c57-0ad4-4bd1-acd3-76841142bfb5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:07.823253 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95ac5c57-0ad4-4bd1-acd3-76841142bfb5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:07.823773 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95ac5c57-0ad4-4bd1-acd3-76841142bfb5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:07.824650 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95ac5c57-0ad4-4bd1-acd3-76841142bfb5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:07.825150 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-95ac5c57-0ad4-4bd1-acd3-76841142bfb5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:07.837081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:07.848620 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:07.858790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:07.858790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fbf29d44-28c6-41ca-abbe-60cb293c6db6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.189822 Jun 23 20:09:07.858790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 130/256] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:07 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:08.037823 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a914abb3-7a51-42f3-bc4d-0b560c144c43 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:08.038318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a914abb3-7a51-42f3-bc4d-0b560c144c43 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:08.044293 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a914abb3-7a51-42f3-bc4d-0b560c144c43 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:08.044805 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a914abb3-7a51-42f3-bc4d-0b560c144c43 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:08.045659 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a914abb3-7a51-42f3-bc4d-0b560c144c43 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:08.045987 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a914abb3-7a51-42f3-bc4d-0b560c144c43 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:08.071585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a914abb3-7a51-42f3-bc4d-0b560c144c43 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:09:08.106657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-95ac5c57-0ad4-4bd1-acd3-76841142bfb5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:08.114141 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-95ac5c57-0ad4-4bd1-acd3-76841142bfb5 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.302363 Jun 23 20:09:08.114703 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 127/257] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:07 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:08.343036 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a914abb3-7a51-42f3-bc4d-0b560c144c43 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 204 len: 0 microversion: 2.1 time: 0.310032 Jun 23 20:09:08.343621 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 131/258] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:09:08 2022] DELETE /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 20:09:08.351973 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a8c289de-82fa-47cc-94c1-203a73ad4b66 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:08.352577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a8c289de-82fa-47cc-94c1-203a73ad4b66 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:08.358652 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8c289de-82fa-47cc-94c1-203a73ad4b66 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:08.359100 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8c289de-82fa-47cc-94c1-203a73ad4b66 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:08.359907 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8c289de-82fa-47cc-94c1-203a73ad4b66 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:08.360374 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8c289de-82fa-47cc-94c1-203a73ad4b66 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:08.524549 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a8c289de-82fa-47cc-94c1-203a73ad4b66 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:08.533666 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a8c289de-82fa-47cc-94c1-203a73ad4b66 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1504 microversion: 2.1 time: 0.184237 Jun 23 20:09:08.533666 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 128/259] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:08 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:08.568472 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-79cee7c8-43e0-4284-8bbb-b5a949b3e86f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:08.568472 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-79cee7c8-43e0-4284-8bbb-b5a949b3e86f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:08.572517 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-79cee7c8-43e0-4284-8bbb-b5a949b3e86f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:08.573008 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-79cee7c8-43e0-4284-8bbb-b5a949b3e86f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:08.573810 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-79cee7c8-43e0-4284-8bbb-b5a949b3e86f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:08.574182 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-79cee7c8-43e0-4284-8bbb-b5a949b3e86f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:08.703496 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-79cee7c8-43e0-4284-8bbb-b5a949b3e86f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:08.710934 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-79cee7c8-43e0-4284-8bbb-b5a949b3e86f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.149961 Jun 23 20:09:08.711551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 132/260] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:08 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:08.870238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:08.870807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:08.879614 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:08.880273 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:08.886324 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:08.886324 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:09.015941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:09.024179 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:09.025737 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:09.026882 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-20beb6cd-b692-41bb-bb29-7c2ac3571379 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.161165 Jun 23 20:09:09.027437 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 129/261] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:08 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:09.130809 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e6924b5d-31c3-42e6-b43f-acb74ef7ebec tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:09.131432 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e6924b5d-31c3-42e6-b43f-acb74ef7ebec tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:09.137694 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6924b5d-31c3-42e6-b43f-acb74ef7ebec tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:09.138146 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6924b5d-31c3-42e6-b43f-acb74ef7ebec tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:09.138925 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6924b5d-31c3-42e6-b43f-acb74ef7ebec tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:09.139360 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6924b5d-31c3-42e6-b43f-acb74ef7ebec tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:09.289957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e6924b5d-31c3-42e6-b43f-acb74ef7ebec tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:09.297397 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e6924b5d-31c3-42e6-b43f-acb74ef7ebec tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.171143 Jun 23 20:09:09.297959 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 133/262] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:09 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:09.449117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-072cb2db-d2da-4b82-8307-c02c4e9b0c95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: .version_select at 0x7f90d9ee8280>, body: {"keypair": {"name": "tempest-keypair-325159526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQg9uSsmfRRatOX/w7HWJm+NiQzfFUcKGR8Dg1gn2MSoqUUQTWl/IWpqoYtY3bnX/oPQDSeMv+UTusb3Xa+xT6SiYoa4zoWUCBhL47+vkEQNJmIhW8Q2HtVSYl+Pz0+tg=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:09.464689 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-072cb2db-d2da-4b82-8307-c02c4e9b0c95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for project bd810755b80346ae9219a2d0c61a8a06. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:09:09.468543 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-072cb2db-d2da-4b82-8307-c02c4e9b0c95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for user 8a5b19c8c0d44e1f93bb1dea72884cc3 and project bd810755b80346ae9219a2d0c61a8a06. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:09:09.549178 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fb239ab9-860f-4b1a-ac73-69c577c5be1c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:09.549743 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fb239ab9-860f-4b1a-ac73-69c577c5be1c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:09.555713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb239ab9-860f-4b1a-ac73-69c577c5be1c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:09.556162 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb239ab9-860f-4b1a-ac73-69c577c5be1c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:09.556962 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb239ab9-860f-4b1a-ac73-69c577c5be1c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:09.557403 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb239ab9-860f-4b1a-ac73-69c577c5be1c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:09.584653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-072cb2db-d2da-4b82-8307-c02c4e9b0c95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139860 Jun 23 20:09:09.585910 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 130/263] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:09:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:09.687406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fb239ab9-860f-4b1a-ac73-69c577c5be1c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:09.695488 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fb239ab9-860f-4b1a-ac73-69c577c5be1c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1504 microversion: 2.1 time: 0.150198 Jun 23 20:09:09.696043 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 134/264] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:09 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:09.726809 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3eb7f0f1-33e6-4239-9592-d9e122d1ff09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:09.727592 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3eb7f0f1-33e6-4239-9592-d9e122d1ff09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:09.733816 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3eb7f0f1-33e6-4239-9592-d9e122d1ff09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:09.734276 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3eb7f0f1-33e6-4239-9592-d9e122d1ff09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:09.735042 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3eb7f0f1-33e6-4239-9592-d9e122d1ff09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:09.735587 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3eb7f0f1-33e6-4239-9592-d9e122d1ff09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:09.864113 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3eb7f0f1-33e6-4239-9592-d9e122d1ff09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:09.871690 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3eb7f0f1-33e6-4239-9592-d9e122d1ff09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.148790 Jun 23 20:09:09.876453 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 131/265] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:09 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:10.046093 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:10.046692 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:10.053450 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:10.053895 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:10.054651 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:10.055082 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:10.060406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:10.194615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:10.203387 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:10.204962 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:10.206134 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c69c6567-2a43-4c79-a194-4237d808fb0e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.163914 Jun 23 20:09:10.206690 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 135/266] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:10 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:10.314194 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-21db21de-b7b2-47ac-a2fb-539bf1b4744b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:10.314798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-21db21de-b7b2-47ac-a2fb-539bf1b4744b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:10.322732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21db21de-b7b2-47ac-a2fb-539bf1b4744b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:10.323575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21db21de-b7b2-47ac-a2fb-539bf1b4744b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:10.324369 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21db21de-b7b2-47ac-a2fb-539bf1b4744b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:10.324990 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21db21de-b7b2-47ac-a2fb-539bf1b4744b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:10.462976 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-21db21de-b7b2-47ac-a2fb-539bf1b4744b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:10.470456 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-21db21de-b7b2-47ac-a2fb-539bf1b4744b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.160203 Jun 23 20:09:10.471023 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 132/267] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:10 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:10.713617 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a05d760e-ec4d-43ce-a7d8-d2cdc3cff7aa tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:10.714176 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a05d760e-ec4d-43ce-a7d8-d2cdc3cff7aa tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:10.720276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a05d760e-ec4d-43ce-a7d8-d2cdc3cff7aa tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:10.720824 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a05d760e-ec4d-43ce-a7d8-d2cdc3cff7aa tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:10.721570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a05d760e-ec4d-43ce-a7d8-d2cdc3cff7aa tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:10.722002 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a05d760e-ec4d-43ce-a7d8-d2cdc3cff7aa tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:10.857938 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a05d760e-ec4d-43ce-a7d8-d2cdc3cff7aa tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:10.865311 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a05d760e-ec4d-43ce-a7d8-d2cdc3cff7aa tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1504 microversion: 2.1 time: 0.156065 Jun 23 20:09:10.865868 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 136/268] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:10 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:10.888833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-34f3a6e1-7b03-4624-8333-471f8016e1b1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:10.889430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-34f3a6e1-7b03-4624-8333-471f8016e1b1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:10.899155 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34f3a6e1-7b03-4624-8333-471f8016e1b1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:10.899598 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34f3a6e1-7b03-4624-8333-471f8016e1b1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:10.900384 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34f3a6e1-7b03-4624-8333-471f8016e1b1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:10.900818 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34f3a6e1-7b03-4624-8333-471f8016e1b1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:11.224158 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:11.224794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:11.250395 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:11.254524 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:11.254524 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:11.254524 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:11.397301 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-34f3a6e1-7b03-4624-8333-471f8016e1b1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:11.405681 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-34f3a6e1-7b03-4624-8333-471f8016e1b1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.520590 Jun 23 20:09:11.406257 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 133/269] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:10 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:11.470565 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:11.479427 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:11.480956 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:11.482104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f04526a6-8753-46f0-adf4-08f68eefa88d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.261931 Jun 23 20:09:11.482700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 137/270] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:11 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:11.486920 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-823f574e-e314-478f-9082-11abbbf70379 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:11.487590 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-823f574e-e314-478f-9082-11abbbf70379 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:11.494876 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-823f574e-e314-478f-9082-11abbbf70379 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:11.495258 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-823f574e-e314-478f-9082-11abbbf70379 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:11.496018 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-823f574e-e314-478f-9082-11abbbf70379 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:11.496504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-823f574e-e314-478f-9082-11abbbf70379 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:11.644804 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-823f574e-e314-478f-9082-11abbbf70379 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:11.652160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-823f574e-e314-478f-9082-11abbbf70379 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1266 microversion: 2.1 time: 0.169158 Jun 23 20:09:11.652756 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 134/271] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:11 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:11.882167 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c9c5e986-1118-439b-8228-8203b53f78e0 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:11.885023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c9c5e986-1118-439b-8228-8203b53f78e0 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:11.888792 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c9c5e986-1118-439b-8228-8203b53f78e0 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:11.889236 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c9c5e986-1118-439b-8228-8203b53f78e0 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:11.889988 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c9c5e986-1118-439b-8228-8203b53f78e0 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:11.890418 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c9c5e986-1118-439b-8228-8203b53f78e0 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:12.049607 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c9c5e986-1118-439b-8228-8203b53f78e0 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:12.057042 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c9c5e986-1118-439b-8228-8203b53f78e0 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1504 microversion: 2.1 time: 0.178705 Jun 23 20:09:12.057598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 138/272] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:11 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:12.422379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6e77d4dd-f0d9-4acd-87ec-47ac129ff08f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:12.422988 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6e77d4dd-f0d9-4acd-87ec-47ac129ff08f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:12.429978 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6e77d4dd-f0d9-4acd-87ec-47ac129ff08f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:12.430128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6e77d4dd-f0d9-4acd-87ec-47ac129ff08f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:12.431042 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6e77d4dd-f0d9-4acd-87ec-47ac129ff08f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:12.431560 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6e77d4dd-f0d9-4acd-87ec-47ac129ff08f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:12.503351 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:12.504949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:12.511311 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:12.512209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:12.513405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:12.513910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:12.612615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6e77d4dd-f0d9-4acd-87ec-47ac129ff08f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:12.622750 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6e77d4dd-f0d9-4acd-87ec-47ac129ff08f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.204859 Jun 23 20:09:12.623633 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 135/273] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:12 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:12.630285 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1161156324", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2163b477-2f70-4f87-a2ba-0f833320ac92"}], "security_groups": [{"name": "tempest-securitygroup--468762640"}], "key_name": "tempest-keypair-325159526", "user_data": "}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:12.694050 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:12.702895 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:12.704492 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:12.706169 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-509eeb1a-d0bb-49d7-833a-d618386833cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.207993 Jun 23 20:09:12.717460 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 139/274] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:12 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:12.722420 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3baa48b4-7ca9-4699-b9c8-8b9920998190 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:12.723284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3baa48b4-7ca9-4699-b9c8-8b9920998190 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:12.729522 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3baa48b4-7ca9-4699-b9c8-8b9920998190 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:12.729967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3baa48b4-7ca9-4699-b9c8-8b9920998190 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:12.730731 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3baa48b4-7ca9-4699-b9c8-8b9920998190 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:12.731166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3baa48b4-7ca9-4699-b9c8-8b9920998190 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:12.742019 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] validate_networks() for [('2163b477-2f70-4f87-a2ba-0f833320ac92', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:09:12.953507 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3baa48b4-7ca9-4699-b9c8-8b9920998190 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:12.961182 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3baa48b4-7ca9-4699-b9c8-8b9920998190 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1453 microversion: 2.1 time: 0.242557 Jun 23 20:09:12.961779 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 140/275] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:12 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1453 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:12.979169 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-36557c85-22cb-47ca-8d4c-99cd879b2b78 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:12.979777 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-36557c85-22cb-47ca-8d4c-99cd879b2b78 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:12.985741 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-36557c85-22cb-47ca-8d4c-99cd879b2b78 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:12.989450 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-36557c85-22cb-47ca-8d4c-99cd879b2b78 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:12.989450 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-36557c85-22cb-47ca-8d4c-99cd879b2b78 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:12.989450 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-36557c85-22cb-47ca-8d4c-99cd879b2b78 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:13.200906 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-36557c85-22cb-47ca-8d4c-99cd879b2b78 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:13.209834 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-36557c85-22cb-47ca-8d4c-99cd879b2b78 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1453 microversion: 2.1 time: 0.234353 Jun 23 20:09:13.210417 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 141/276] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:12 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1453 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:13.216566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3384ebca-9a1f-4ff0-a554-ebb8a51ee04c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:13.216566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3384ebca-9a1f-4ff0-a554-ebb8a51ee04c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:13.221638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3384ebca-9a1f-4ff0-a554-ebb8a51ee04c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:13.222030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3384ebca-9a1f-4ff0-a554-ebb8a51ee04c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:13.223310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3384ebca-9a1f-4ff0-a554-ebb8a51ee04c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:13.223944 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3384ebca-9a1f-4ff0-a554-ebb8a51ee04c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:13.323512 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:09:13.324239 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:09:13.324746 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:09:13.325444 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:09:13.326059 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:09:13.336005 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:13.336491 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:13.337630 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:13.338268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:13.364146 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for project bd810755b80346ae9219a2d0c61a8a06. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:09:13.368591 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for user 8a5b19c8c0d44e1f93bb1dea72884cc3 and project bd810755b80346ae9219a2d0c61a8a06. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:09:13.381778 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:09:13.384543 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:09:13.387662 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3384ebca-9a1f-4ff0-a554-ebb8a51ee04c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:13.397924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3384ebca-9a1f-4ff0-a554-ebb8a51ee04c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1504 microversion: 2.1 time: 0.186474 Jun 23 20:09:13.398936 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 142/277] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:13 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:13.563775 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-20ca9aee-14e6-4bff-b043-cc7c174e10bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.938700 Jun 23 20:09:13.564530 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 136/278] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:09:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:09:13.575035 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-599ed92d-f365-4412-847d-0315ef3ba7ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:13.575637 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-599ed92d-f365-4412-847d-0315ef3ba7ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:13.629826 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-599ed92d-f365-4412-847d-0315ef3ba7ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:13.637327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-599ed92d-f365-4412-847d-0315ef3ba7ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1241 microversion: 2.1 time: 0.066320 Jun 23 20:09:13.637885 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 143/279] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:13 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:13.640840 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-682e2c95-3003-4291-a4b6-12bf3a0058dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:13.641448 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-682e2c95-3003-4291-a4b6-12bf3a0058dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:13.647714 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-682e2c95-3003-4291-a4b6-12bf3a0058dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:13.648467 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-682e2c95-3003-4291-a4b6-12bf3a0058dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:13.649596 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-682e2c95-3003-4291-a4b6-12bf3a0058dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:13.650151 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-682e2c95-3003-4291-a4b6-12bf3a0058dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:13.729667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:13.729667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:13.732721 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:13.733067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:13.741028 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:13.741544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:13.915356 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-682e2c95-3003-4291-a4b6-12bf3a0058dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:13.923459 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-682e2c95-3003-4291-a4b6-12bf3a0058dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.286665 Jun 23 20:09:13.926652 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 137/280] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:13 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:13.995770 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:14.004541 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:14.006317 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:14.007177 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-72d54717-9080-4cc7-ac62-1ef5107edf4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.286519 Jun 23 20:09:14.007888 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 144/281] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:13 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:14.419745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-08745eb5-692e-4bca-9d3e-a8f2a48d956b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:14.420766 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-08745eb5-692e-4bca-9d3e-a8f2a48d956b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:14.436037 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08745eb5-692e-4bca-9d3e-a8f2a48d956b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:14.436890 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08745eb5-692e-4bca-9d3e-a8f2a48d956b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:14.437714 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08745eb5-692e-4bca-9d3e-a8f2a48d956b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:14.444504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-08745eb5-692e-4bca-9d3e-a8f2a48d956b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:14.654463 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-64cd3397-43cb-4d17-ab74-9a0fc092487e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:14.655673 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-64cd3397-43cb-4d17-ab74-9a0fc092487e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:14.661923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-64cd3397-43cb-4d17-ab74-9a0fc092487e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:14.662310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-64cd3397-43cb-4d17-ab74-9a0fc092487e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:14.663080 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-64cd3397-43cb-4d17-ab74-9a0fc092487e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:14.663751 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-64cd3397-43cb-4d17-ab74-9a0fc092487e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:14.692439 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-08745eb5-692e-4bca-9d3e-a8f2a48d956b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:14.705748 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-08745eb5-692e-4bca-9d3e-a8f2a48d956b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1504 microversion: 2.1 time: 0.294151 Jun 23 20:09:14.707209 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 138/282] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:14 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:14.768528 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-64cd3397-43cb-4d17-ab74-9a0fc092487e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:14.776423 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-64cd3397-43cb-4d17-ab74-9a0fc092487e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1245 microversion: 2.1 time: 0.125777 Jun 23 20:09:14.777011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 145/283] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:14 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:14.948378 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be365a4a-5ae7-4fba-abf0-70485a92b142 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:14.949236 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be365a4a-5ae7-4fba-abf0-70485a92b142 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:14.956474 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be365a4a-5ae7-4fba-abf0-70485a92b142 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:14.957908 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be365a4a-5ae7-4fba-abf0-70485a92b142 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:14.958957 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be365a4a-5ae7-4fba-abf0-70485a92b142 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:14.959857 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be365a4a-5ae7-4fba-abf0-70485a92b142 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:15.026044 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:15.026647 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:15.032715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:15.033416 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:15.034366 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:15.034973 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:15.159833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be365a4a-5ae7-4fba-abf0-70485a92b142 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:15.174519 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be365a4a-5ae7-4fba-abf0-70485a92b142 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.232619 Jun 23 20:09:15.185438 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 139/284] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:14 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:15.317527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:15.328765 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-974926c2-2f59-4bf3-a28e-8f1c60117fe6 req-a10a5b74-c058-4c2b-b42b-f719f8c87982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc58eeec-d1c2-4007-8c87-b60f15e48c34", "name": "network-vif-deleted", "tag": "ecf3dc34-4797-4907-bc20-27a9826c848a"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:15.340711 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:15.342039 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:15.343199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-974926c2-2f59-4bf3-a28e-8f1c60117fe6 req-a10a5b74-c058-4c2b-b42b-f719f8c87982 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:15.343783 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-974926c2-2f59-4bf3-a28e-8f1c60117fe6 req-a10a5b74-c058-4c2b-b42b-f719f8c87982 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:15.346971 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:15.350812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d6147c8c-0c0f-407c-a44a-87444106ea58 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.327736 Jun 23 20:09:15.366234 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 146/285] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:15 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:15.367182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-974926c2-2f59-4bf3-a28e-8f1c60117fe6 req-a10a5b74-c058-4c2b-b42b-f719f8c87982 service nova] Creating event network-vif-deleted:ecf3dc34-4797-4907-bc20-27a9826c848a for instance fc58eeec-d1c2-4007-8c87-b60f15e48c34 on hv-cinder-84727 Jun 23 20:09:15.375885 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-974926c2-2f59-4bf3-a28e-8f1c60117fe6 req-a10a5b74-c058-4c2b-b42b-f719f8c87982 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064801 Jun 23 20:09:15.376567 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 140/286] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:15.723829 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-580c3f70-b2b2-47bb-a995-21170018733a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:15.724565 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-580c3f70-b2b2-47bb-a995-21170018733a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:15.731285 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-580c3f70-b2b2-47bb-a995-21170018733a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:15.731723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-580c3f70-b2b2-47bb-a995-21170018733a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:15.732678 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-580c3f70-b2b2-47bb-a995-21170018733a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:15.733112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-580c3f70-b2b2-47bb-a995-21170018733a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:15.795712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e62aa877-07c9-49d9-93c6-23d310ab41e9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:15.796368 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e62aa877-07c9-49d9-93c6-23d310ab41e9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:15.816039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e62aa877-07c9-49d9-93c6-23d310ab41e9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:15.816553 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e62aa877-07c9-49d9-93c6-23d310ab41e9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:15.817334 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e62aa877-07c9-49d9-93c6-23d310ab41e9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:15.821526 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e62aa877-07c9-49d9-93c6-23d310ab41e9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:15.822211 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-580c3f70-b2b2-47bb-a995-21170018733a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:15.830070 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-580c3f70-b2b2-47bb-a995-21170018733a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1462 microversion: 2.1 time: 0.110856 Jun 23 20:09:15.830831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 147/287] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:15 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1462 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:15.904979 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e62aa877-07c9-49d9-93c6-23d310ab41e9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:15.914123 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e62aa877-07c9-49d9-93c6-23d310ab41e9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1237 microversion: 2.1 time: 0.123106 Jun 23 20:09:15.914697 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 141/288] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:15 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1237 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:16.080914 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-75a9084f-70dc-41a2-9366-fe2b468e74cb req-e8bcf7eb-7ff2-45c1-bba7-3cb39d962f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200f25e9-8d0e-42eb-91b6-57db370e99e1", "tag": "34cb6df8-f4a2-46ac-ab20-64414d2a90b1"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:16.090286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-75a9084f-70dc-41a2-9366-fe2b468e74cb req-e8bcf7eb-7ff2-45c1-bba7-3cb39d962f41 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:16.090778 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-75a9084f-70dc-41a2-9366-fe2b468e74cb req-e8bcf7eb-7ff2-45c1-bba7-3cb39d962f41 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:16.104901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-75a9084f-70dc-41a2-9366-fe2b468e74cb req-e8bcf7eb-7ff2-45c1-bba7-3cb39d962f41 service nova] Creating event network-changed:34cb6df8-f4a2-46ac-ab20-64414d2a90b1 for instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 on hv-cinder-84727 Jun 23 20:09:16.109023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-75a9084f-70dc-41a2-9366-fe2b468e74cb req-e8bcf7eb-7ff2-45c1-bba7-3cb39d962f41 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031853 Jun 23 20:09:16.109618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 148/289] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:16.192778 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ac2796b3-002c-463b-a2d1-d540d9cba51c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:16.193389 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ac2796b3-002c-463b-a2d1-d540d9cba51c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:16.199634 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac2796b3-002c-463b-a2d1-d540d9cba51c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:16.200083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac2796b3-002c-463b-a2d1-d540d9cba51c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:16.200890 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac2796b3-002c-463b-a2d1-d540d9cba51c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:16.201326 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac2796b3-002c-463b-a2d1-d540d9cba51c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:16.338224 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ac2796b3-002c-463b-a2d1-d540d9cba51c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:16.348528 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ac2796b3-002c-463b-a2d1-d540d9cba51c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.159441 Jun 23 20:09:16.357617 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 142/290] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:16 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:16.374646 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:16.375538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:16.384052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:16.384825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:16.385509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:16.385939 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:16.540515 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:16.548873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:16.550389 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:16.552113 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ec3eb548-685c-41eb-8001-7202e56725d6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.182043 Jun 23 20:09:16.552695 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 149/291] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:16 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:16.847280 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-67655a0c-bea3-4363-b737-e9e19afecfd3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:16.848432 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-67655a0c-bea3-4363-b737-e9e19afecfd3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:16.855523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-67655a0c-bea3-4363-b737-e9e19afecfd3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:16.855975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-67655a0c-bea3-4363-b737-e9e19afecfd3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:16.857024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-67655a0c-bea3-4363-b737-e9e19afecfd3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:16.857464 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-67655a0c-bea3-4363-b737-e9e19afecfd3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:16.879601 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:16.924452 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-67655a0c-bea3-4363-b737-e9e19afecfd3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:16.933598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fe60157a-6c33-4abd-b3e0-573e5656b745 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:16.934413 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fe60157a-6c33-4abd-b3e0-573e5656b745 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:16.941338 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fe60157a-6c33-4abd-b3e0-573e5656b745 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:16.942070 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fe60157a-6c33-4abd-b3e0-573e5656b745 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:16.942924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fe60157a-6c33-4abd-b3e0-573e5656b745 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:16.943632 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fe60157a-6c33-4abd-b3e0-573e5656b745 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:16.953136 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-67655a0c-bea3-4363-b737-e9e19afecfd3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1462 microversion: 2.1 time: 0.109846 Jun 23 20:09:16.953711 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 143/292] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:16 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1462 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:17.148425 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fe60157a-6c33-4abd-b3e0-573e5656b745 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:17.155932 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fe60157a-6c33-4abd-b3e0-573e5656b745 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1237 microversion: 2.1 time: 0.226914 Jun 23 20:09:17.156534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 150/293] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:16 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1237 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:17.364768 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3490005f-183a-4983-81d6-1e7444ba5f48 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:17.365366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3490005f-183a-4983-81d6-1e7444ba5f48 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:17.371405 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3490005f-183a-4983-81d6-1e7444ba5f48 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:17.371849 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3490005f-183a-4983-81d6-1e7444ba5f48 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:17.372630 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3490005f-183a-4983-81d6-1e7444ba5f48 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:17.373060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3490005f-183a-4983-81d6-1e7444ba5f48 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:17.515916 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3490005f-183a-4983-81d6-1e7444ba5f48 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:17.524055 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3490005f-183a-4983-81d6-1e7444ba5f48 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.163184 Jun 23 20:09:17.524675 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 144/294] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:17 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:17.570819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:17.571433 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:17.577764 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:17.578314 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:17.578965 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:17.579396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:17.705333 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:17.713737 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:17.715230 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:17.716391 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-15e6e6d6-1ceb-4ef1-9900-2f70be6c6e80 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.149998 Jun 23 20:09:17.716932 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 151/295] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:17 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:17.969338 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c10c7571-9349-4fc2-a95a-2510609a555c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:17.969942 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c10c7571-9349-4fc2-a95a-2510609a555c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:17.976754 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c10c7571-9349-4fc2-a95a-2510609a555c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:17.981208 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c10c7571-9349-4fc2-a95a-2510609a555c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:17.981208 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c10c7571-9349-4fc2-a95a-2510609a555c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:17.981208 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c10c7571-9349-4fc2-a95a-2510609a555c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:18.040723 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c10c7571-9349-4fc2-a95a-2510609a555c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:18.048136 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c10c7571-9349-4fc2-a95a-2510609a555c tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1462 microversion: 2.1 time: 0.082664 Jun 23 20:09:18.048982 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 145/296] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:17 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:18.175226 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-83cd9400-c16f-4620-8385-a68626d3668f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:18.176430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-83cd9400-c16f-4620-8385-a68626d3668f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:18.183780 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83cd9400-c16f-4620-8385-a68626d3668f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:18.184223 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83cd9400-c16f-4620-8385-a68626d3668f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:18.185045 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83cd9400-c16f-4620-8385-a68626d3668f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:18.185478 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83cd9400-c16f-4620-8385-a68626d3668f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:18.248998 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-83cd9400-c16f-4620-8385-a68626d3668f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:18.256323 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-83cd9400-c16f-4620-8385-a68626d3668f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1237 microversion: 2.1 time: 0.085118 Jun 23 20:09:18.256969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 152/297] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:18 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:18.541572 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b17d578f-5883-42dc-b30a-8d0947fe4eda tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:18.542104 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b17d578f-5883-42dc-b30a-8d0947fe4eda tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:18.548189 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b17d578f-5883-42dc-b30a-8d0947fe4eda tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:18.548675 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b17d578f-5883-42dc-b30a-8d0947fe4eda tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:18.549436 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b17d578f-5883-42dc-b30a-8d0947fe4eda tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:18.549875 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b17d578f-5883-42dc-b30a-8d0947fe4eda tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:18.682034 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b17d578f-5883-42dc-b30a-8d0947fe4eda tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:18.689595 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b17d578f-5883-42dc-b30a-8d0947fe4eda tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.151968 Jun 23 20:09:18.693228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 146/298] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:18 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:18.734201 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:18.734812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:18.740897 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:18.741344 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:18.742106 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:18.742548 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:18.760051 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=100 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:18.851627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-420f6dff-9a26-46bd-af2a-fc6cf8a2cea0 req-bbdadbf5-2310-4d9f-b93e-e492775fcc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5de1ee-6219-48dc-af73-d21b440c9122", "name": "network-vif-plugged", "status": "completed", "tag": "27c60352-48b3-4e75-b043-6c1f57dcdca4"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:18.863822 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-420f6dff-9a26-46bd-af2a-fc6cf8a2cea0 req-bbdadbf5-2310-4d9f-b93e-e492775fcc95 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:18.864330 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-420f6dff-9a26-46bd-af2a-fc6cf8a2cea0 req-bbdadbf5-2310-4d9f-b93e-e492775fcc95 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:18.878251 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:18.879694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-420f6dff-9a26-46bd-af2a-fc6cf8a2cea0 req-bbdadbf5-2310-4d9f-b93e-e492775fcc95 service nova] Creating event network-vif-plugged:27c60352-48b3-4e75-b043-6c1f57dcdca4 for instance 6e5de1ee-6219-48dc-af73-d21b440c9122 on hv-cinder-84727 Jun 23 20:09:18.885336 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-420f6dff-9a26-46bd-af2a-fc6cf8a2cea0 req-bbdadbf5-2310-4d9f-b93e-e492775fcc95 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041095 Jun 23 20:09:18.886110 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 147/299] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:09:18.889569 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:18.891083 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:18.892231 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-297961fe-1b93-476f-be21-4ab384c41698 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.162029 Jun 23 20:09:18.892847 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 153/300] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:18 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:19.067272 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:19.068151 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:19.077486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:19.094704 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:19.094704 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:19.094704 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:19.126255 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:19.126714 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:19.127175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lazy-loading 'fault' on Instance uuid fc58eeec-d1c2-4007-8c87-b60f15e48c34 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:09:19.213940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:19.222436 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f75e309a-fe98-4dc7-a8c0-18ef94169de6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1303 microversion: 2.1 time: 0.161327 Jun 23 20:09:19.223058 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 148/301] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:19 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:19.273048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-381f0d52-1756-4e4c-a091-05b1c6b32146 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:19.273649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-381f0d52-1756-4e4c-a091-05b1c6b32146 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:19.279663 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381f0d52-1756-4e4c-a091-05b1c6b32146 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:19.280107 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381f0d52-1756-4e4c-a091-05b1c6b32146 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:19.282467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381f0d52-1756-4e4c-a091-05b1c6b32146 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:19.282467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381f0d52-1756-4e4c-a091-05b1c6b32146 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:19.347127 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-381f0d52-1756-4e4c-a091-05b1c6b32146 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:19.355386 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-381f0d52-1756-4e4c-a091-05b1c6b32146 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1237 microversion: 2.1 time: 0.086724 Jun 23 20:09:19.355957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 154/302] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:19 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:19.708669 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e68758d3-834c-4112-8719-af6295d9fdca tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:19.709433 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e68758d3-834c-4112-8719-af6295d9fdca tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:19.715919 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e68758d3-834c-4112-8719-af6295d9fdca tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:19.716410 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e68758d3-834c-4112-8719-af6295d9fdca tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:19.717765 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e68758d3-834c-4112-8719-af6295d9fdca tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:19.718368 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e68758d3-834c-4112-8719-af6295d9fdca tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:19.888210 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e68758d3-834c-4112-8719-af6295d9fdca tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:19.895944 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e68758d3-834c-4112-8719-af6295d9fdca tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.190985 Jun 23 20:09:19.896710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 149/303] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:19 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:19.911981 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:19.912612 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:19.918724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:19.919171 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:19.920142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:19.920592 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:20.059366 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:20.067410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:20.068940 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:20.070081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a642ca37-1857-4605-b1e9-df514daed353 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1745 microversion: 2.20 time: 0.162966 Jun 23 20:09:20.070628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 155/304] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:19 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:20.249517 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:20.250641 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:20.257586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:20.258374 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:20.259309 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:20.259876 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:20.298015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:20.298458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:20.299289 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lazy-loading 'fault' on Instance uuid fc58eeec-d1c2-4007-8c87-b60f15e48c34 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:09:20.358512 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:20.365900 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d2c08f30-fd46-460a-b5c8-9126c4f47383 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 200 len: 1303 microversion: 2.1 time: 0.121059 Jun 23 20:09:20.366490 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 150/305] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:20 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:20.372709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7da6cede-bf3e-4ebf-84dd-e58523272c99 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:20.374697 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7da6cede-bf3e-4ebf-84dd-e58523272c99 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:20.379345 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7da6cede-bf3e-4ebf-84dd-e58523272c99 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:20.379784 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7da6cede-bf3e-4ebf-84dd-e58523272c99 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:20.380606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7da6cede-bf3e-4ebf-84dd-e58523272c99 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:20.381254 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7da6cede-bf3e-4ebf-84dd-e58523272c99 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:20.443176 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7da6cede-bf3e-4ebf-84dd-e58523272c99 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:20.450928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7da6cede-bf3e-4ebf-84dd-e58523272c99 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1293 microversion: 2.1 time: 0.081957 Jun 23 20:09:20.451473 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 156/306] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:20 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:20.915819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8c87dae6-430a-46e5-bf43-eac475d840fd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:20.916369 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8c87dae6-430a-46e5-bf43-eac475d840fd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:20.928732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8c87dae6-430a-46e5-bf43-eac475d840fd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:20.929208 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8c87dae6-430a-46e5-bf43-eac475d840fd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:20.929998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8c87dae6-430a-46e5-bf43-eac475d840fd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:20.930433 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8c87dae6-430a-46e5-bf43-eac475d840fd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:21.089169 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:21.089775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:21.096669 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:21.097163 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:21.097977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:21.098411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:21.412027 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8c87dae6-430a-46e5-bf43-eac475d840fd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:21.433307 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8c87dae6-430a-46e5-bf43-eac475d840fd tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1369 microversion: 2.1 time: 0.508760 Jun 23 20:09:21.433307 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 151/307] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:20 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1369 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:21.433307 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:21.433307 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: fc58eeec-d1c2-4007-8c87-b60f15e48c34] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:21.433307 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:21.433845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:21.434532 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:21.435044 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:21.440552 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:21.449906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] HTTP exception thrown: Instance fc58eeec-d1c2-4007-8c87-b60f15e48c34 could not be found. Jun 23 20:09:21.450723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Request method failure captured: Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 HTTP/1.1 Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMhMFKk9i7FG822yQS16oTvvt8-cC1QyEqhmXgXKkqDpKj0CKwv8d5p4RRfSA0wvSi-amZUyYWgwtlJLNsv0jh1beaAJ2IACBkBEJk3oqm3bvIp9LimrhoczAxHYUOnwVzf4tNa44upfWDB5bBHyTTVj1QhIKkiXCQXIP28fO_PzUdg Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: df7d693ea21441559f4db447f5414f69 Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesActionsTest-1992940749 Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:09:21.451712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_df7d693ea21441559f4db447f5414f69", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df7d693ea21441559f4db447f5414f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df7d693ea21441559f4db447f5414f69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/df7d693ea21441559f4db447f5414f69"}]}] Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesActionsTest-1992940749 Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: df7d693ea21441559f4db447f5414f69 Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesActionsTest-1992940749 Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesActionsTest-1992940749-project Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: a6a6e5f6e5f24ba89ca4895aebe158f8 Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesActionsTest-1992940749-project Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance fc58eeec-d1c2-4007-8c87-b60f15e48c34 could not be found. Jun 23 20:09:21.453264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'fc58eeec-d1c2-4007-8c87-b60f15e48c34'} Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc58eeec-d1c2-4007-8c87-b60f15e48c34 could not be found. Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:09:21.454106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc58eeec-d1c2-4007-8c87-b60f15e48c34 could not be found. Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc58eeec-d1c2-4007-8c87-b60f15e48c34 could not be found. Jun 23 20:09:21.455458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:09:21.458476 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Returning 404 to user: Instance fc58eeec-d1c2-4007-8c87-b60f15e48c34 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:09:21.458566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:21.458674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f5876606-6fbc-4b94-954d-4e7dfd7c678e tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34" status: 404 len: 111 microversion: 2.1 time: 0.030788 Jun 23 20:09:21.458674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 152/308] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:21 2022] GET /compute/v2.1/servers/fc58eeec-d1c2-4007-8c87-b60f15e48c34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:09:21.458843 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f73bab54-9171-4c03-b44a-a730ac646b72 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1745 microversion: 2.20 time: 0.369288 Jun 23 20:09:21.458843 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 157/309] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:21 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1745 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:21.468929 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ce2f75df-84f7-42c1-8dbf-778fac74fd2a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:21.469529 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ce2f75df-84f7-42c1-8dbf-778fac74fd2a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:21.476130 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce2f75df-84f7-42c1-8dbf-778fac74fd2a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:21.481660 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce2f75df-84f7-42c1-8dbf-778fac74fd2a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:21.481660 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce2f75df-84f7-42c1-8dbf-778fac74fd2a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:21.481660 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ce2f75df-84f7-42c1-8dbf-778fac74fd2a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:21.548242 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ce2f75df-84f7-42c1-8dbf-778fac74fd2a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:21.558104 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ce2f75df-84f7-42c1-8dbf-778fac74fd2a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1293 microversion: 2.1 time: 0.092950 Jun 23 20:09:21.558660 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 153/310] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:21 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:21.577071 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1675039099", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "networks": [{"uuid": "885d343b-d90c-4197-a6fc-92476b1e08bf"}]}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:21.631570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] validate_networks() for [('885d343b-d90c-4197-a6fc-92476b1e08bf', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:09:21.970970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:09:21.971371 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:09:21.971832 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:09:21.972229 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:09:21.972722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:09:21.982352 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:21.982790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:21.983577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:21.984003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:22.000422 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Getting quotas for project df7d693ea21441559f4db447f5414f69. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:09:22.004789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Getting quotas for user a6a6e5f6e5f24ba89ca4895aebe158f8 and project df7d693ea21441559f4db447f5414f69. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:09:22.015835 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:09:22.018418 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:09:22.166649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c932a604-9285-491a-9efa-cccbf7fb6453 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593704 Jun 23 20:09:22.167290 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 158/311] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:09:22.177228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-09917bfd-6cfb-47df-a5a6-5274dac91847 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:22.177922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-09917bfd-6cfb-47df-a5a6-5274dac91847 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:22.232097 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-09917bfd-6cfb-47df-a5a6-5274dac91847 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:22.243397 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-09917bfd-6cfb-47df-a5a6-5274dac91847 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1214 microversion: 2.1 time: 0.070058 Jun 23 20:09:22.244134 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 154/312] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:22 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:22.445435 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-69d3aaa4-695d-4fc5-9a5e-a212a56c7d76 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:22.446099 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-69d3aaa4-695d-4fc5-9a5e-a212a56c7d76 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:22.460714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-69d3aaa4-695d-4fc5-9a5e-a212a56c7d76 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:22.461298 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-69d3aaa4-695d-4fc5-9a5e-a212a56c7d76 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:22.462073 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-69d3aaa4-695d-4fc5-9a5e-a212a56c7d76 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:22.462505 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-69d3aaa4-695d-4fc5-9a5e-a212a56c7d76 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:22.485089 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:22.486393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:22.506375 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:22.507153 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:22.508155 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:22.508783 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:22.655983 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-69d3aaa4-695d-4fc5-9a5e-a212a56c7d76 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:22.664158 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-69d3aaa4-695d-4fc5-9a5e-a212a56c7d76 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1563 microversion: 2.1 time: 0.223331 Jun 23 20:09:22.664864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 159/313] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:22 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:22.669470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9f12be81-5a85-4304-9df4-5ad78f193e73 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:22.670120 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9f12be81-5a85-4304-9df4-5ad78f193e73 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:22.676174 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f12be81-5a85-4304-9df4-5ad78f193e73 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:22.676652 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f12be81-5a85-4304-9df4-5ad78f193e73 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:22.677448 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f12be81-5a85-4304-9df4-5ad78f193e73 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:22.677871 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f12be81-5a85-4304-9df4-5ad78f193e73 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:22.682904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:22.690879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:22.692416 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:22.693562 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-56b53ac9-e55c-4fa8-a44d-5e207d5ff9c6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1745 microversion: 2.20 time: 0.213110 Jun 23 20:09:22.694248 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 155/314] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:22 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1745 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:22.700270 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d901bba3-60d1-402a-a92e-42911fa486fe tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:22.700793 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d901bba3-60d1-402a-a92e-42911fa486fe tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:22.707590 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d901bba3-60d1-402a-a92e-42911fa486fe tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:22.708035 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d901bba3-60d1-402a-a92e-42911fa486fe tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:22.708987 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d901bba3-60d1-402a-a92e-42911fa486fe tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:22.709419 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d901bba3-60d1-402a-a92e-42911fa486fe tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:22.742217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9f12be81-5a85-4304-9df4-5ad78f193e73 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:22.749762 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9f12be81-5a85-4304-9df4-5ad78f193e73 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1301 microversion: 2.1 time: 0.083683 Jun 23 20:09:22.750441 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 160/315] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:22 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:22.793945 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d901bba3-60d1-402a-a92e-42911fa486fe tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097488 Jun 23 20:09:22.794536 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 156/316] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 23 20:09:22 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:23.260990 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1839c1da-87f7-4461-b26a-bf479fee380b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:23.261618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1839c1da-87f7-4461-b26a-bf479fee380b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:23.267608 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1839c1da-87f7-4461-b26a-bf479fee380b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:23.268050 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1839c1da-87f7-4461-b26a-bf479fee380b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:23.268827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1839c1da-87f7-4461-b26a-bf479fee380b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:23.269256 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1839c1da-87f7-4461-b26a-bf479fee380b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:23.328320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1839c1da-87f7-4461-b26a-bf479fee380b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:23.335643 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1839c1da-87f7-4461-b26a-bf479fee380b tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1218 microversion: 2.1 time: 0.078501 Jun 23 20:09:23.336200 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 161/317] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:23 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:23.716427 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:23.721043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:23.721652 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:23.728514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:23.728865 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:23.729663 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:23.730194 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:23.769615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1592c0aa-3405-4d14-b26e-67370a1c49e6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:23.770978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1592c0aa-3405-4d14-b26e-67370a1c49e6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:23.778671 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1592c0aa-3405-4d14-b26e-67370a1c49e6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:23.779115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1592c0aa-3405-4d14-b26e-67370a1c49e6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:23.779870 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1592c0aa-3405-4d14-b26e-67370a1c49e6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:23.780336 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1592c0aa-3405-4d14-b26e-67370a1c49e6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:23.860070 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1592c0aa-3405-4d14-b26e-67370a1c49e6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:23.869179 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1592c0aa-3405-4d14-b26e-67370a1c49e6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1301 microversion: 2.1 time: 0.104463 Jun 23 20:09:23.879733 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 162/318] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:23 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1301 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:23.884950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-8ad4922e-cd6c-4501-9472-2e20dfd5483e req-013694b5-0c06-48f9-82b0-74d9d33eca55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5de1ee-6219-48dc-af73-d21b440c9122", "tag": "27c60352-48b3-4e75-b043-6c1f57dcdca4"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:23.890188 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:23.895884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-8ad4922e-cd6c-4501-9472-2e20dfd5483e req-013694b5-0c06-48f9-82b0-74d9d33eca55 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:23.896329 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-8ad4922e-cd6c-4501-9472-2e20dfd5483e req-013694b5-0c06-48f9-82b0-74d9d33eca55 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:23.908327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-8ad4922e-cd6c-4501-9472-2e20dfd5483e req-013694b5-0c06-48f9-82b0-74d9d33eca55 service nova] Creating event network-changed:27c60352-48b3-4e75-b043-6c1f57dcdca4 for instance 6e5de1ee-6219-48dc-af73-d21b440c9122 on hv-cinder-84727 Jun 23 20:09:23.913552 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:23.920416 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-8ad4922e-cd6c-4501-9472-2e20dfd5483e req-013694b5-0c06-48f9-82b0-74d9d33eca55 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039061 Jun 23 20:09:23.922615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 163/319] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:23.924113 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:23.925553 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:23.928751 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ac8f72db-be80-4331-93a0-058ec5a72f73 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1745 microversion: 2.20 time: 0.211336 Jun 23 20:09:23.937940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 157/320] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:23 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:24.190470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-f1c17184-531f-45d3-9120-7edd03c07b9e req-a89eff65-f2f4-4a7c-8f26-41920f5dc85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a", "name": "network-vif-plugged", "status": "completed", "tag": "01e605d9-8bd3-4f1a-81cd-9ad85b78e81a"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:24.199922 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-f1c17184-531f-45d3-9120-7edd03c07b9e req-a89eff65-f2f4-4a7c-8f26-41920f5dc85e service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:24.200544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-f1c17184-531f-45d3-9120-7edd03c07b9e req-a89eff65-f2f4-4a7c-8f26-41920f5dc85e service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:24.211911 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-f1c17184-531f-45d3-9120-7edd03c07b9e req-a89eff65-f2f4-4a7c-8f26-41920f5dc85e service nova] Creating event network-vif-plugged:01e605d9-8bd3-4f1a-81cd-9ad85b78e81a for instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a on hv-cinder-84727 Jun 23 20:09:24.216810 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-f1c17184-531f-45d3-9120-7edd03c07b9e req-a89eff65-f2f4-4a7c-8f26-41920f5dc85e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030629 Jun 23 20:09:24.217389 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 164/321] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:24.352650 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-634b8f22-d203-4cff-9465-113057972196 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:24.353261 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-634b8f22-d203-4cff-9465-113057972196 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:24.359309 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-634b8f22-d203-4cff-9465-113057972196 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:24.359740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-634b8f22-d203-4cff-9465-113057972196 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:24.360535 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-634b8f22-d203-4cff-9465-113057972196 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:24.360971 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-634b8f22-d203-4cff-9465-113057972196 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:24.424919 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-634b8f22-d203-4cff-9465-113057972196 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:24.432426 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-634b8f22-d203-4cff-9465-113057972196 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1218 microversion: 2.1 time: 0.083845 Jun 23 20:09:24.432988 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 158/322] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:24 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:24.887978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1fa8f199-5536-43ca-b8e0-388f57209408 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:24.888745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1fa8f199-5536-43ca-b8e0-388f57209408 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:24.896010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1fa8f199-5536-43ca-b8e0-388f57209408 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:24.896487 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1fa8f199-5536-43ca-b8e0-388f57209408 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:24.897253 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1fa8f199-5536-43ca-b8e0-388f57209408 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:24.897680 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1fa8f199-5536-43ca-b8e0-388f57209408 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:24.948147 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:24.948699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:24.955714 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:24.956162 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:24.957022 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:24.957507 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:24.972539 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1fa8f199-5536-43ca-b8e0-388f57209408 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:24.980474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1fa8f199-5536-43ca-b8e0-388f57209408 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1301 microversion: 2.1 time: 0.097322 Jun 23 20:09:24.993917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 165/323] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:24 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1301 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:25.124602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:25.132627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:25.134132 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:25.135342 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c646f815-c42f-488a-9c85-e146f5bc2a3e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1745 microversion: 2.20 time: 0.191755 Jun 23 20:09:25.135922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 159/324] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:24 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:25.450122 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-cdc2b5c7-de1d-49b0-b105-183db4880791 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:25.451735 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-cdc2b5c7-de1d-49b0-b105-183db4880791 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:25.457580 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cdc2b5c7-de1d-49b0-b105-183db4880791 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:25.458039 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cdc2b5c7-de1d-49b0-b105-183db4880791 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:25.458775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cdc2b5c7-de1d-49b0-b105-183db4880791 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:25.459210 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cdc2b5c7-de1d-49b0-b105-183db4880791 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:25.581659 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-cdc2b5c7-de1d-49b0-b105-183db4880791 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:25.590620 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-cdc2b5c7-de1d-49b0-b105-183db4880791 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1218 microversion: 2.1 time: 0.144721 Jun 23 20:09:25.591493 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 166/325] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:25 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:25.998379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dd4ced2a-e236-4ee2-8cf7-de7b13630c9c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:25.999025 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dd4ced2a-e236-4ee2-8cf7-de7b13630c9c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:26.006312 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd4ced2a-e236-4ee2-8cf7-de7b13630c9c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:26.006771 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd4ced2a-e236-4ee2-8cf7-de7b13630c9c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:26.007541 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd4ced2a-e236-4ee2-8cf7-de7b13630c9c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:26.008172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dd4ced2a-e236-4ee2-8cf7-de7b13630c9c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:26.096098 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dd4ced2a-e236-4ee2-8cf7-de7b13630c9c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:26.107399 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dd4ced2a-e236-4ee2-8cf7-de7b13630c9c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1299 microversion: 2.1 time: 0.113407 Jun 23 20:09:26.108699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 160/326] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:25 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:26.157222 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:26.158205 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:26.164842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:26.165281 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:26.166042 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:26.166472 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:26.358330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:26.370326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:26.372401 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:26.373664 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a3c0c277-6d8f-42a4-851c-c5c095181cd5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.223948 Jun 23 20:09:26.374350 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 167/327] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:26 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:26.608777 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a3e6acc0-7f34-4e85-9ed8-f52f6768aed2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:26.609681 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a3e6acc0-7f34-4e85-9ed8-f52f6768aed2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:26.624350 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3e6acc0-7f34-4e85-9ed8-f52f6768aed2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:26.624490 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3e6acc0-7f34-4e85-9ed8-f52f6768aed2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:26.625484 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3e6acc0-7f34-4e85-9ed8-f52f6768aed2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:26.626107 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a3e6acc0-7f34-4e85-9ed8-f52f6768aed2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:26.757941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a3e6acc0-7f34-4e85-9ed8-f52f6768aed2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:26.779699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a3e6acc0-7f34-4e85-9ed8-f52f6768aed2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1266 microversion: 2.1 time: 0.175094 Jun 23 20:09:26.781404 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 161/328] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:26 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:27.129577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7d7bcf00-e2ef-4170-8884-10fdd90ac107 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:27.130636 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7d7bcf00-e2ef-4170-8884-10fdd90ac107 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:27.148381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7d7bcf00-e2ef-4170-8884-10fdd90ac107 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:27.150556 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7d7bcf00-e2ef-4170-8884-10fdd90ac107 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:27.153051 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7d7bcf00-e2ef-4170-8884-10fdd90ac107 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:27.154443 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7d7bcf00-e2ef-4170-8884-10fdd90ac107 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:27.393425 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:27.395303 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:27.408133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:27.409058 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:27.412157 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:27.412877 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:27.419367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7d7bcf00-e2ef-4170-8884-10fdd90ac107 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:27.420318 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:27.429959 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7d7bcf00-e2ef-4170-8884-10fdd90ac107 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1366 microversion: 2.1 time: 0.305817 Jun 23 20:09:27.430533 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 168/329] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:27 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:27.805636 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-42449a84-4bf9-423a-a13f-8552009410e2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:27.814241 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-42449a84-4bf9-423a-a13f-8552009410e2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:27.835714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42449a84-4bf9-423a-a13f-8552009410e2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:27.840755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42449a84-4bf9-423a-a13f-8552009410e2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:28.065745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42449a84-4bf9-423a-a13f-8552009410e2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:28.065745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42449a84-4bf9-423a-a13f-8552009410e2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:28.171545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-42449a84-4bf9-423a-a13f-8552009410e2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:28.177058 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-42449a84-4bf9-423a-a13f-8552009410e2 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1272 microversion: 2.1 time: 0.379433 Jun 23 20:09:28.188432 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 169/330] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:27 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1272 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:28.325998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:28.349775 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:28.370191 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:28.375444 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-03338173-a2b6-404a-9a59-12ea5beda634 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.984630 Jun 23 20:09:28.380189 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 162/331] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:27 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:28.450595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ed097c4e-1910-4da0-aac6-2429b20c7239 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:28.451386 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ed097c4e-1910-4da0-aac6-2429b20c7239 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:28.458644 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ed097c4e-1910-4da0-aac6-2429b20c7239 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:28.461698 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ed097c4e-1910-4da0-aac6-2429b20c7239 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:28.461698 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ed097c4e-1910-4da0-aac6-2429b20c7239 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:28.461698 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ed097c4e-1910-4da0-aac6-2429b20c7239 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:28.677913 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ed097c4e-1910-4da0-aac6-2429b20c7239 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:28.691994 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-90745998-dec6-40fb-b979-a9302fa71802 req-f6241b32-6a01-4a78-8d33-146b8ca561e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e635b7-eb5c-48a2-9806-5ac7d9f3c809", "tag": "4af33271-c5e4-4644-953f-371408d0d791"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:28.699964 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ed097c4e-1910-4da0-aac6-2429b20c7239 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1366 microversion: 2.1 time: 0.256596 Jun 23 20:09:28.704324 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 170/332] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:28 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:28.709305 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-90745998-dec6-40fb-b979-a9302fa71802 req-f6241b32-6a01-4a78-8d33-146b8ca561e8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:28.715294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-90745998-dec6-40fb-b979-a9302fa71802 req-f6241b32-6a01-4a78-8d33-146b8ca561e8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:28.733522 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-90745998-dec6-40fb-b979-a9302fa71802 req-f6241b32-6a01-4a78-8d33-146b8ca561e8 service nova] Creating event network-changed:4af33271-c5e4-4644-953f-371408d0d791 for instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 on hv-cinder-84727 Jun 23 20:09:28.742980 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-90745998-dec6-40fb-b979-a9302fa71802 req-f6241b32-6a01-4a78-8d33-146b8ca561e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054507 Jun 23 20:09:28.744584 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 163/333] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:29.196767 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-94d78f8e-ef30-4bcc-bf21-8acb62a03ee9 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:29.221709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-94d78f8e-ef30-4bcc-bf21-8acb62a03ee9 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:29.221709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-94d78f8e-ef30-4bcc-bf21-8acb62a03ee9 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:29.221709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-94d78f8e-ef30-4bcc-bf21-8acb62a03ee9 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:29.221709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-94d78f8e-ef30-4bcc-bf21-8acb62a03ee9 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:29.222068 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-94d78f8e-ef30-4bcc-bf21-8acb62a03ee9 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:29.405586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:29.415731 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:29.422921 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:29.423975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:29.425016 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:29.425789 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:29.588573 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-94d78f8e-ef30-4bcc-bf21-8acb62a03ee9 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:29.638551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-94d78f8e-ef30-4bcc-bf21-8acb62a03ee9 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.442044 Jun 23 20:09:29.638551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 171/334] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:29 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:29.720774 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-dfac2d86-8e87-4dc7-9280-0cee90985b95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:29.721487 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-dfac2d86-8e87-4dc7-9280-0cee90985b95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:29.731700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dfac2d86-8e87-4dc7-9280-0cee90985b95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:29.732165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dfac2d86-8e87-4dc7-9280-0cee90985b95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:29.734396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dfac2d86-8e87-4dc7-9280-0cee90985b95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:29.734843 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dfac2d86-8e87-4dc7-9280-0cee90985b95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:29.744888 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=100 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:29.962925 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:29.986111 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:29.998277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:30.001101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b1a6baaf-2117-4b05-ac3f-297040c6df0a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.598431 Jun 23 20:09:30.002035 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 164/335] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:29 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:30.020762 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-653636b0-7324-4b7e-a9c1-1f320f3ced4d req-3e5beec5-ed35-4fda-9b66-b6ef85a73a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a9a669-c9d7-46c6-a901-1e5b99c820e2", "tag": "71746899-262d-4424-8ec8-9692c4396671"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:30.030994 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-653636b0-7324-4b7e-a9c1-1f320f3ced4d req-3e5beec5-ed35-4fda-9b66-b6ef85a73a29 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:30.032070 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-653636b0-7324-4b7e-a9c1-1f320f3ced4d req-3e5beec5-ed35-4fda-9b66-b6ef85a73a29 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:30.046809 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-653636b0-7324-4b7e-a9c1-1f320f3ced4d req-3e5beec5-ed35-4fda-9b66-b6ef85a73a29 service nova] Creating event network-changed:71746899-262d-4424-8ec8-9692c4396671 for instance b9a9a669-c9d7-46c6-a901-1e5b99c820e2 on hv-cinder-84727 Jun 23 20:09:30.054798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-653636b0-7324-4b7e-a9c1-1f320f3ced4d req-3e5beec5-ed35-4fda-9b66-b6ef85a73a29 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050197 Jun 23 20:09:30.055455 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 165/336] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:30.184739 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-dfac2d86-8e87-4dc7-9280-0cee90985b95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:30.192699 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-dfac2d86-8e87-4dc7-9280-0cee90985b95 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1366 microversion: 2.1 time: 0.476222 Jun 23 20:09:30.203931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 172/337] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:29 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:30.656386 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-90ebe185-0829-4aa1-b2c7-73d96928a366 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:30.657216 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-90ebe185-0829-4aa1-b2c7-73d96928a366 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:30.670956 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-90ebe185-0829-4aa1-b2c7-73d96928a366 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:30.671344 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-90ebe185-0829-4aa1-b2c7-73d96928a366 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:30.672102 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-90ebe185-0829-4aa1-b2c7-73d96928a366 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:30.672569 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-90ebe185-0829-4aa1-b2c7-73d96928a366 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:30.806070 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-90ebe185-0829-4aa1-b2c7-73d96928a366 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:30.816190 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-90ebe185-0829-4aa1-b2c7-73d96928a366 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.163272 Jun 23 20:09:30.816190 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 166/338] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:30 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:31.024355 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:31.025872 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:31.033383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:31.034468 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:31.035724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:31.036394 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:31.212659 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-87248fe5-49cc-4d1a-8ee1-62a12622d010 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:31.213171 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-87248fe5-49cc-4d1a-8ee1-62a12622d010 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:31.216157 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:31.219803 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-87248fe5-49cc-4d1a-8ee1-62a12622d010 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:31.220259 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-87248fe5-49cc-4d1a-8ee1-62a12622d010 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:31.222913 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-87248fe5-49cc-4d1a-8ee1-62a12622d010 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:31.222913 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-87248fe5-49cc-4d1a-8ee1-62a12622d010 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:31.229199 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:31.231100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:31.232546 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-339995b7-45c0-439b-950b-598ccbf1fc05 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.216171 Jun 23 20:09:31.245760 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 173/339] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:31 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:31.409274 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-87248fe5-49cc-4d1a-8ee1-62a12622d010 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:31.416557 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-87248fe5-49cc-4d1a-8ee1-62a12622d010 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1366 microversion: 2.1 time: 0.207880 Jun 23 20:09:31.427069 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 167/340] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:31 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:31.831066 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-73ea8e1d-9a1c-4934-8e1e-f6f44f657863 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:31.831670 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-73ea8e1d-9a1c-4934-8e1e-f6f44f657863 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:31.847714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-73ea8e1d-9a1c-4934-8e1e-f6f44f657863 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:31.850845 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-73ea8e1d-9a1c-4934-8e1e-f6f44f657863 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:31.850845 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-73ea8e1d-9a1c-4934-8e1e-f6f44f657863 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:31.850845 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-73ea8e1d-9a1c-4934-8e1e-f6f44f657863 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:31.993613 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:32.011455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=8 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:32.075024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-73ea8e1d-9a1c-4934-8e1e-f6f44f657863 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:32.089151 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-73ea8e1d-9a1c-4934-8e1e-f6f44f657863 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.262028 Jun 23 20:09:32.090530 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 174/341] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:31 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:32.254022 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:32.255382 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:32.267006 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=12 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:32.275083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:32.275541 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:32.276992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:32.279204 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:32.438929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-991e1d71-49ab-4139-8258-77851c0591f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:32.440125 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-991e1d71-49ab-4139-8258-77851c0591f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:32.457882 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-991e1d71-49ab-4139-8258-77851c0591f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:32.458720 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-991e1d71-49ab-4139-8258-77851c0591f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:32.459966 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-991e1d71-49ab-4139-8258-77851c0591f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:32.461332 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-991e1d71-49ab-4139-8258-77851c0591f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:32.624230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:32.638139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:32.640023 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:32.641818 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-27fd480c-bd96-484f-802c-6abeba70d704 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.394301 Jun 23 20:09:32.642388 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 168/342] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:32 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:32.735260 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-991e1d71-49ab-4139-8258-77851c0591f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:32.748820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-991e1d71-49ab-4139-8258-77851c0591f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1366 microversion: 2.1 time: 0.318444 Jun 23 20:09:32.749931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 175/343] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:32 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:33.106633 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-936fba3e-8ef0-46d5-a260-6e9ca6cd24f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:33.107237 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-936fba3e-8ef0-46d5-a260-6e9ca6cd24f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:33.115682 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-936fba3e-8ef0-46d5-a260-6e9ca6cd24f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:33.115965 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-936fba3e-8ef0-46d5-a260-6e9ca6cd24f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:33.116729 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-936fba3e-8ef0-46d5-a260-6e9ca6cd24f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:33.117168 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-936fba3e-8ef0-46d5-a260-6e9ca6cd24f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:33.371618 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-936fba3e-8ef0-46d5-a260-6e9ca6cd24f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:33.395603 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-936fba3e-8ef0-46d5-a260-6e9ca6cd24f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.292704 Jun 23 20:09:33.404757 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 169/344] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:33 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:33.660439 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:33.661664 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:33.667948 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:33.668419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:33.669176 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:33.679671 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:33.765844 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d17e01d7-5ee5-4478-a4dc-0a8ea4fde968 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:33.766578 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d17e01d7-5ee5-4478-a4dc-0a8ea4fde968 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:33.783103 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d17e01d7-5ee5-4478-a4dc-0a8ea4fde968 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:33.785349 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d17e01d7-5ee5-4478-a4dc-0a8ea4fde968 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:33.786287 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d17e01d7-5ee5-4478-a4dc-0a8ea4fde968 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:33.796976 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d17e01d7-5ee5-4478-a4dc-0a8ea4fde968 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:34.052016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:34.069443 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d17e01d7-5ee5-4478-a4dc-0a8ea4fde968 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:34.074942 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:34.077302 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d17e01d7-5ee5-4478-a4dc-0a8ea4fde968 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1366 microversion: 2.1 time: 0.315230 Jun 23 20:09:34.090143 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 170/345] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:33 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:34.090256 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:34.090256 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9eec2b65-78af-4a57-9582-dd928bbc8443 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.427354 Jun 23 20:09:34.090256 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 176/346] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:33 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:34.413318 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3c3a160e-cfda-48d1-845e-35b9c1a02b23 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:34.413924 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3c3a160e-cfda-48d1-845e-35b9c1a02b23 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:34.420839 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3c3a160e-cfda-48d1-845e-35b9c1a02b23 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:34.421299 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3c3a160e-cfda-48d1-845e-35b9c1a02b23 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:34.422083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3c3a160e-cfda-48d1-845e-35b9c1a02b23 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:34.422520 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3c3a160e-cfda-48d1-845e-35b9c1a02b23 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:34.567024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3c3a160e-cfda-48d1-845e-35b9c1a02b23 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:34.574901 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3c3a160e-cfda-48d1-845e-35b9c1a02b23 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.166352 Jun 23 20:09:34.578366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 171/347] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:34 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:35.098795 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8d4af93f-659d-40d0-b002-882ddcd84241 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:35.099634 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8d4af93f-659d-40d0-b002-882ddcd84241 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:35.103570 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:35.104565 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:35.110825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8d4af93f-659d-40d0-b002-882ddcd84241 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:35.111422 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8d4af93f-659d-40d0-b002-882ddcd84241 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:35.112490 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8d4af93f-659d-40d0-b002-882ddcd84241 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:35.112930 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8d4af93f-659d-40d0-b002-882ddcd84241 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:35.117927 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:35.117927 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:35.119581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:35.122089 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:35.484423 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8d4af93f-659d-40d0-b002-882ddcd84241 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:35.491968 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8d4af93f-659d-40d0-b002-882ddcd84241 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1366 microversion: 2.1 time: 0.396636 Jun 23 20:09:35.492173 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:35.498548 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 177/348] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:35 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:35.521794 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:35.521794 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:35.521794 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5690bdd4-d54e-497c-abda-492bab53b91d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.417956 Jun 23 20:09:35.522078 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 172/349] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:35 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:35.566313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-eb24e002-b75a-416b-a749-95e47a17b405 req-0ba8108b-3202-47d8-9ebf-2e331139f447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e635b7-eb5c-48a2-9806-5ac7d9f3c809", "name": "network-vif-plugged", "status": "completed", "tag": "4af33271-c5e4-4644-953f-371408d0d791"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:35.593008 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-21cd0b7e-ffbb-4853-bd66-bf86fff9e510 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:35.593885 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-21cd0b7e-ffbb-4853-bd66-bf86fff9e510 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:35.598695 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-eb24e002-b75a-416b-a749-95e47a17b405 req-0ba8108b-3202-47d8-9ebf-2e331139f447 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:35.600932 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-eb24e002-b75a-416b-a749-95e47a17b405 req-0ba8108b-3202-47d8-9ebf-2e331139f447 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:35.602277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21cd0b7e-ffbb-4853-bd66-bf86fff9e510 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:35.603440 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21cd0b7e-ffbb-4853-bd66-bf86fff9e510 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:35.605022 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21cd0b7e-ffbb-4853-bd66-bf86fff9e510 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:35.607445 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21cd0b7e-ffbb-4853-bd66-bf86fff9e510 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:35.621012 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-eb24e002-b75a-416b-a749-95e47a17b405 req-0ba8108b-3202-47d8-9ebf-2e331139f447 service nova] Creating event network-vif-plugged:4af33271-c5e4-4644-953f-371408d0d791 for instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 on hv-cinder-84727 Jun 23 20:09:35.626395 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-eb24e002-b75a-416b-a749-95e47a17b405 req-0ba8108b-3202-47d8-9ebf-2e331139f447 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063709 Jun 23 20:09:35.630601 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 178/350] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:09:35.779705 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-21cd0b7e-ffbb-4853-bd66-bf86fff9e510 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:35.788120 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-21cd0b7e-ffbb-4853-bd66-bf86fff9e510 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.199404 Jun 23 20:09:35.798228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 173/351] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:35 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:36.516261 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3744a1ad-a86a-4685-aa67-a715639b3b17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:36.518265 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3744a1ad-a86a-4685-aa67-a715639b3b17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:36.528878 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3744a1ad-a86a-4685-aa67-a715639b3b17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:36.530214 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3744a1ad-a86a-4685-aa67-a715639b3b17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:36.531545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3744a1ad-a86a-4685-aa67-a715639b3b17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:36.533014 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3744a1ad-a86a-4685-aa67-a715639b3b17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:36.537932 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:36.539155 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:36.546940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:36.546940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:36.546940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:36.553113 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:36.764648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:36.767487 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3744a1ad-a86a-4685-aa67-a715639b3b17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:36.775142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3744a1ad-a86a-4685-aa67-a715639b3b17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1366 microversion: 2.1 time: 0.266568 Jun 23 20:09:36.776924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 179/352] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:36 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:36.792421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:36.794117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:36.795339 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a5c6fa13-16dd-4e43-a1c3-6e3718564cfb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.262014 Jun 23 20:09:36.807132 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 174/353] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:36 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:36.818147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-83f90ef7-d491-4b5f-8a8c-499926bc80ad tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:36.819077 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-83f90ef7-d491-4b5f-8a8c-499926bc80ad tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:36.825607 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83f90ef7-d491-4b5f-8a8c-499926bc80ad tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:36.826248 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83f90ef7-d491-4b5f-8a8c-499926bc80ad tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:36.827195 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83f90ef7-d491-4b5f-8a8c-499926bc80ad tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:36.827625 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-83f90ef7-d491-4b5f-8a8c-499926bc80ad tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:37.011612 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-83f90ef7-d491-4b5f-8a8c-499926bc80ad tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:37.019456 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-83f90ef7-d491-4b5f-8a8c-499926bc80ad tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.206454 Jun 23 20:09:37.020056 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 180/354] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:36 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:37.209529 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1426212551", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:37.287185 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] validate_networks() for None {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:09:37.644876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-15ca8d81-c701-4bdd-8566-faf28f376ce6 req-48aaf74b-0c50-45c5-9b07-ff0c02b65e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a9a669-c9d7-46c6-a901-1e5b99c820e2", "name": "network-vif-plugged", "status": "completed", "tag": "71746899-262d-4424-8ec8-9692c4396671"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:37.657464 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-15ca8d81-c701-4bdd-8566-faf28f376ce6 req-48aaf74b-0c50-45c5-9b07-ff0c02b65e02 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:37.658865 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-15ca8d81-c701-4bdd-8566-faf28f376ce6 req-48aaf74b-0c50-45c5-9b07-ff0c02b65e02 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:37.672203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-15ca8d81-c701-4bdd-8566-faf28f376ce6 req-48aaf74b-0c50-45c5-9b07-ff0c02b65e02 service nova] Creating event network-vif-plugged:71746899-262d-4424-8ec8-9692c4396671 for instance b9a9a669-c9d7-46c6-a901-1e5b99c820e2 on hv-cinder-84727 Jun 23 20:09:37.679920 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:09:37.681007 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:09:37.682235 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:09:37.682669 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:09:37.683085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:09:37.693939 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-15ca8d81-c701-4bdd-8566-faf28f376ce6 req-48aaf74b-0c50-45c5-9b07-ff0c02b65e02 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051004 Jun 23 20:09:37.694566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 181/355] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:37.697153 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:37.697607 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:37.698883 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:37.699307 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:37.721513 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Getting quotas for project fee2271744814fe9b2726faa89cfe1bc. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:09:37.726845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Getting quotas for user 3457dad643d34950834cc41462aa412b and project fee2271744814fe9b2726faa89cfe1bc. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:09:37.744220 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:09:37.746786 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:09:37.795707 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c97297c3-9e93-4616-abe1-d8699c99f466 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:37.796498 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c97297c3-9e93-4616-abe1-d8699c99f466 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:37.828412 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c97297c3-9e93-4616-abe1-d8699c99f466 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:37.828794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c97297c3-9e93-4616-abe1-d8699c99f466 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:37.834382 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c97297c3-9e93-4616-abe1-d8699c99f466 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:37.835041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c97297c3-9e93-4616-abe1-d8699c99f466 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:37.990546 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-978072af-a9c3-462c-ae76-36f3c5bd3b16 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787326 Jun 23 20:09:37.997315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 175/356] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:09:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:09:38.003649 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:38.004869 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:38.019540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:38.019540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:38.019540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:38.019540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:38.060227 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c97297c3-9e93-4616-abe1-d8699c99f466 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:38.069982 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c97297c3-9e93-4616-abe1-d8699c99f466 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1366 microversion: 2.1 time: 0.279545 Jun 23 20:09:38.082957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 182/357] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:37 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:38.097737 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-caf466ef-b630-47fd-9fe4-9e9c45e82fcd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:38.099070 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-caf466ef-b630-47fd-9fe4-9e9c45e82fcd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:38.185426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-caf466ef-b630-47fd-9fe4-9e9c45e82fcd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:38.207897 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-caf466ef-b630-47fd-9fe4-9e9c45e82fcd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1215 microversion: 2.1 time: 0.118903 Jun 23 20:09:38.211217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 183/358] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:38 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:38.223960 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b17c8e5e-18d6-41cb-a7cc-3831db7bdb4a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:38.226016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b17c8e5e-18d6-41cb-a7cc-3831db7bdb4a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:38.247927 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b17c8e5e-18d6-41cb-a7cc-3831db7bdb4a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:38.248647 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b17c8e5e-18d6-41cb-a7cc-3831db7bdb4a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:38.249596 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b17c8e5e-18d6-41cb-a7cc-3831db7bdb4a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:38.250443 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b17c8e5e-18d6-41cb-a7cc-3831db7bdb4a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:38.321290 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:38.338550 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:38.340431 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:38.342181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3a891585-1297-4ddf-aa84-0e56ce47f684 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.342553 Jun 23 20:09:38.348547 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 176/359] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:37 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:38.480814 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b17c8e5e-18d6-41cb-a7cc-3831db7bdb4a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:38.490912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b17c8e5e-18d6-41cb-a7cc-3831db7bdb4a tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.277680 Jun 23 20:09:38.491773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 184/360] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:38 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:39.104508 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1aa4f689-6a22-4aba-97ab-b815367ee7be tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:39.105133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1aa4f689-6a22-4aba-97ab-b815367ee7be tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:39.111740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1aa4f689-6a22-4aba-97ab-b815367ee7be tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:39.112180 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1aa4f689-6a22-4aba-97ab-b815367ee7be tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:39.112962 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1aa4f689-6a22-4aba-97ab-b815367ee7be tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:39.113906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1aa4f689-6a22-4aba-97ab-b815367ee7be tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:39.227355 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-95494ee3-7910-4239-a1bb-755e896f3672 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:39.227956 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-95494ee3-7910-4239-a1bb-755e896f3672 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:39.295533 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-95494ee3-7910-4239-a1bb-755e896f3672 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:39.299765 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1aa4f689-6a22-4aba-97ab-b815367ee7be tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:39.302825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-95494ee3-7910-4239-a1bb-755e896f3672 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1215 microversion: 2.1 time: 0.079777 Jun 23 20:09:39.303392 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 185/361] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:39 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:39.308013 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1aa4f689-6a22-4aba-97ab-b815367ee7be tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1555 microversion: 2.1 time: 0.224980 Jun 23 20:09:39.308601 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 177/362] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:39 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:39.324143 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2469ce2d-9742-408c-8289-87afb33044c6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:39.324654 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2469ce2d-9742-408c-8289-87afb33044c6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:39.330553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2469ce2d-9742-408c-8289-87afb33044c6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:39.330989 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2469ce2d-9742-408c-8289-87afb33044c6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:39.331730 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2469ce2d-9742-408c-8289-87afb33044c6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:39.332156 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2469ce2d-9742-408c-8289-87afb33044c6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:39.373085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:39.373711 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:39.379894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:39.381869 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:39.382678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:39.383122 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:39.423302 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2469ce2d-9742-408c-8289-87afb33044c6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102998 Jun 23 20:09:39.424287 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 186/363] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 23 20:09:39 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:09:39.508744 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0f67cf22-265a-4755-8a84-4d2c6481dbf7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:39.512520 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0f67cf22-265a-4755-8a84-4d2c6481dbf7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:39.516481 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-265a-4755-8a84-4d2c6481dbf7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:39.516922 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-265a-4755-8a84-4d2c6481dbf7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:39.527305 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-265a-4755-8a84-4d2c6481dbf7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:39.528111 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-265a-4755-8a84-4d2c6481dbf7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:39.548824 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:39.566425 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:39.570424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:39.575812 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c2245d25-0396-4e05-ba05-8311fea0b9ee tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.212644 Jun 23 20:09:39.576460 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 178/364] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:39 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:39.750634 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0f67cf22-265a-4755-8a84-4d2c6481dbf7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:39.760275 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0f67cf22-265a-4755-8a84-4d2c6481dbf7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.255294 Jun 23 20:09:39.765029 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 187/365] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:39 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:40.319765 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2477af75-db2a-47b8-8d76-5e375fc8a018 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:40.320591 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2477af75-db2a-47b8-8d76-5e375fc8a018 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:40.328720 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2477af75-db2a-47b8-8d76-5e375fc8a018 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:40.329172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2477af75-db2a-47b8-8d76-5e375fc8a018 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:40.329976 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2477af75-db2a-47b8-8d76-5e375fc8a018 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:40.330413 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2477af75-db2a-47b8-8d76-5e375fc8a018 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:40.409561 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2477af75-db2a-47b8-8d76-5e375fc8a018 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:40.417016 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2477af75-db2a-47b8-8d76-5e375fc8a018 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1219 microversion: 2.1 time: 0.101823 Jun 23 20:09:40.417574 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 179/366] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:40 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:40.594187 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:40.594785 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:40.601779 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:40.602245 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:40.603030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:40.603640 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:40.746947 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:40.770674 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:40.772165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:40.773643 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ad5ea0b2-c75f-4128-806d-29c836878c28 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1740 microversion: 2.20 time: 0.183494 Jun 23 20:09:40.774914 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 188/367] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:40 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:40.791720 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cbe3717a-4381-46dd-babb-bb08d001a7c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:40.792487 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cbe3717a-4381-46dd-babb-bb08d001a7c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:40.794455 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:40.800585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbe3717a-4381-46dd-babb-bb08d001a7c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:40.801717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbe3717a-4381-46dd-babb-bb08d001a7c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:40.802822 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbe3717a-4381-46dd-babb-bb08d001a7c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:40.803470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbe3717a-4381-46dd-babb-bb08d001a7c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:40.993034 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cbe3717a-4381-46dd-babb-bb08d001a7c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:41.010722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:41.011793 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cbe3717a-4381-46dd-babb-bb08d001a7c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1314 microversion: 2.1 time: 0.224012 Jun 23 20:09:41.021524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 180/368] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:40 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:41.114944 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-3260718c-5b6c-45be-bf95-0541086a0e86 req-f67707ed-da89-4878-8fea-8bb08dc59b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e635b7-eb5c-48a2-9806-5ac7d9f3c809", "tag": "4af33271-c5e4-4644-953f-371408d0d791"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:41.123239 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3260718c-5b6c-45be-bf95-0541086a0e86 req-f67707ed-da89-4878-8fea-8bb08dc59b04 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:41.132558 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3260718c-5b6c-45be-bf95-0541086a0e86 req-f67707ed-da89-4878-8fea-8bb08dc59b04 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:41.145734 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-3260718c-5b6c-45be-bf95-0541086a0e86 req-f67707ed-da89-4878-8fea-8bb08dc59b04 service nova] Creating event network-changed:4af33271-c5e4-4644-953f-371408d0d791 for instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 on hv-cinder-84727 Jun 23 20:09:41.150937 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-3260718c-5b6c-45be-bf95-0541086a0e86 req-f67707ed-da89-4878-8fea-8bb08dc59b04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039604 Jun 23 20:09:41.154575 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 189/369] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:41.436748 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c3fd6d2e-f026-47be-b181-032f1c2cc67a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:41.437448 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c3fd6d2e-f026-47be-b181-032f1c2cc67a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:41.445292 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3fd6d2e-f026-47be-b181-032f1c2cc67a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:41.445880 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3fd6d2e-f026-47be-b181-032f1c2cc67a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:41.446703 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3fd6d2e-f026-47be-b181-032f1c2cc67a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:41.447213 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c3fd6d2e-f026-47be-b181-032f1c2cc67a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:41.513947 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c3fd6d2e-f026-47be-b181-032f1c2cc67a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:41.522375 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c3fd6d2e-f026-47be-b181-032f1c2cc67a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1267 microversion: 2.1 time: 0.091216 Jun 23 20:09:41.523526 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 181/370] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:41 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:41.794768 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:41.795492 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:41.802328 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:41.802769 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:41.803525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:41.803955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:41.943461 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:41.952752 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:41.954194 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:41.955340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-448b495c-8524-45cc-9dc7-78a7208f4d77 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1722 microversion: 2.20 time: 0.164931 Jun 23 20:09:41.955889 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 190/371] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:41 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:42.028944 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bfd177fe-44bc-4536-9187-58c8cb49f3c3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:42.030984 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bfd177fe-44bc-4536-9187-58c8cb49f3c3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:42.037013 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bfd177fe-44bc-4536-9187-58c8cb49f3c3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:42.037605 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bfd177fe-44bc-4536-9187-58c8cb49f3c3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:42.038563 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bfd177fe-44bc-4536-9187-58c8cb49f3c3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:42.038987 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bfd177fe-44bc-4536-9187-58c8cb49f3c3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:42.224113 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bfd177fe-44bc-4536-9187-58c8cb49f3c3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:42.231636 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bfd177fe-44bc-4536-9187-58c8cb49f3c3 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1499 microversion: 2.1 time: 0.207277 Jun 23 20:09:42.236595 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 182/372] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:42 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1499 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:42.540201 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-69d23fbc-f740-4280-8e4e-78d317e954e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:42.540931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-69d23fbc-f740-4280-8e4e-78d317e954e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:42.547720 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-69d23fbc-f740-4280-8e4e-78d317e954e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:42.548438 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-69d23fbc-f740-4280-8e4e-78d317e954e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:42.549211 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-69d23fbc-f740-4280-8e4e-78d317e954e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:42.549801 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-69d23fbc-f740-4280-8e4e-78d317e954e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:42.883115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-69d23fbc-f740-4280-8e4e-78d317e954e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:42.896163 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-69d23fbc-f740-4280-8e4e-78d317e954e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1275 microversion: 2.1 time: 0.360882 Jun 23 20:09:42.896766 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 191/373] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:42 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:42.981015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:42.981627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:42.989004 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:42.989459 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:42.990226 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:42.990730 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:43.278472 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:43.287271 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:43.288816 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:43.291509 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ab2b340c-9624-4bbc-8fe3-122edcb7a908 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1722 microversion: 2.20 time: 0.312841 Jun 23 20:09:43.291509 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 183/374] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:42 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:43.419155 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1046ea5b-07cb-421f-b142-c6c1028e6d9d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:43.419737 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1046ea5b-07cb-421f-b142-c6c1028e6d9d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:43.427094 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1046ea5b-07cb-421f-b142-c6c1028e6d9d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:43.429700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1046ea5b-07cb-421f-b142-c6c1028e6d9d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:43.429700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1046ea5b-07cb-421f-b142-c6c1028e6d9d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:43.429700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1046ea5b-07cb-421f-b142-c6c1028e6d9d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:43.454014 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1046ea5b-07cb-421f-b142-c6c1028e6d9d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:09:43.467565 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=100 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:43.709642 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1046ea5b-07cb-421f-b142-c6c1028e6d9d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 204 len: 0 microversion: 2.1 time: 0.294260 Jun 23 20:09:43.710278 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 192/375] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:09:43 2022] DELETE /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:09:43.718745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a4361fea-6b6b-4ddb-bb08-0625a0eb69f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:43.721905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a4361fea-6b6b-4ddb-bb08-0625a0eb69f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:43.726389 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a4361fea-6b6b-4ddb-bb08-0625a0eb69f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:43.727004 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a4361fea-6b6b-4ddb-bb08-0625a0eb69f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:43.727841 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a4361fea-6b6b-4ddb-bb08-0625a0eb69f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:43.728316 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a4361fea-6b6b-4ddb-bb08-0625a0eb69f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:43.900000 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a4361fea-6b6b-4ddb-bb08-0625a0eb69f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:43.908177 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a4361fea-6b6b-4ddb-bb08-0625a0eb69f6 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1505 microversion: 2.1 time: 0.193475 Jun 23 20:09:43.911076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 184/376] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:43 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:43.913706 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fb8bf0aa-4818-4aea-bc34-a1ca25e9314a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:43.914394 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fb8bf0aa-4818-4aea-bc34-a1ca25e9314a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:43.920509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb8bf0aa-4818-4aea-bc34-a1ca25e9314a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:43.920952 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb8bf0aa-4818-4aea-bc34-a1ca25e9314a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:43.921699 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb8bf0aa-4818-4aea-bc34-a1ca25e9314a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:43.922168 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb8bf0aa-4818-4aea-bc34-a1ca25e9314a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:43.987986 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fb8bf0aa-4818-4aea-bc34-a1ca25e9314a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:43.995939 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fb8bf0aa-4818-4aea-bc34-a1ca25e9314a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1273 microversion: 2.1 time: 0.086996 Jun 23 20:09:43.996532 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 193/377] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:43 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:44.308091 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:44.308700 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:44.315107 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:44.315546 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:44.316331 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:44.316767 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:44.446626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:44.454930 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:44.468708 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:44.468708 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d9bef93c-5e60-42c0-ba10-732acde1911a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1722 microversion: 2.20 time: 0.153936 Jun 23 20:09:44.468708 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 185/378] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:44 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:44.925920 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5ab07a46-ace7-4e0f-9c01-4bddc10beb98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:44.926752 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5ab07a46-ace7-4e0f-9c01-4bddc10beb98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:44.932722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5ab07a46-ace7-4e0f-9c01-4bddc10beb98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:44.933180 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5ab07a46-ace7-4e0f-9c01-4bddc10beb98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:44.933912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5ab07a46-ace7-4e0f-9c01-4bddc10beb98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:44.934342 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5ab07a46-ace7-4e0f-9c01-4bddc10beb98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:45.014031 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-48c2bd41-6c9d-4b55-b301-e3140e0d282e tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:45.015025 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-48c2bd41-6c9d-4b55-b301-e3140e0d282e tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:45.022738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48c2bd41-6c9d-4b55-b301-e3140e0d282e tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:45.023500 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48c2bd41-6c9d-4b55-b301-e3140e0d282e tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:45.024278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48c2bd41-6c9d-4b55-b301-e3140e0d282e tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:45.024766 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48c2bd41-6c9d-4b55-b301-e3140e0d282e tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:45.080362 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5ab07a46-ace7-4e0f-9c01-4bddc10beb98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:45.088647 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5ab07a46-ace7-4e0f-9c01-4bddc10beb98 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1505 microversion: 2.1 time: 0.166678 Jun 23 20:09:45.089312 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 194/379] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:44 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:45.167485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-48c2bd41-6c9d-4b55-b301-e3140e0d282e tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:45.179133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-48c2bd41-6c9d-4b55-b301-e3140e0d282e tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.169066 Jun 23 20:09:45.180362 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 186/380] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:45 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:45.282973 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-a735e984-7e27-42c0-92a7-c2619f4a5fda req-c9ae58f6-54df-463f-a247-9c8eae3e2c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a", "name": "network-vif-unplugged", "status": "completed", "tag": "01e605d9-8bd3-4f1a-81cd-9ad85b78e81a"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:45.292887 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-a735e984-7e27-42c0-92a7-c2619f4a5fda req-c9ae58f6-54df-463f-a247-9c8eae3e2c79 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:45.295790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-a735e984-7e27-42c0-92a7-c2619f4a5fda req-c9ae58f6-54df-463f-a247-9c8eae3e2c79 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:45.306475 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-a735e984-7e27-42c0-92a7-c2619f4a5fda req-c9ae58f6-54df-463f-a247-9c8eae3e2c79 service nova] Creating event network-vif-unplugged:01e605d9-8bd3-4f1a-81cd-9ad85b78e81a for instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a on hv-cinder-84727 Jun 23 20:09:45.311423 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-a735e984-7e27-42c0-92a7-c2619f4a5fda req-c9ae58f6-54df-463f-a247-9c8eae3e2c79 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033901 Jun 23 20:09:45.312068 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 195/381] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:45.475706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:45.476325 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:45.482976 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:45.483441 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:45.484216 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:45.484701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:45.755620 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:45.763482 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:45.764999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:45.766153 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0105ce8b-4737-44a8-ae0a-c15152cac91f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1722 microversion: 2.20 time: 0.294440 Jun 23 20:09:45.766892 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 187/382] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:45 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:46.105700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3c6b4e77-5827-4c17-ae93-ec7ece296df7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:46.106383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3c6b4e77-5827-4c17-ae93-ec7ece296df7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:46.112742 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3c6b4e77-5827-4c17-ae93-ec7ece296df7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:46.113215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3c6b4e77-5827-4c17-ae93-ec7ece296df7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:46.114003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3c6b4e77-5827-4c17-ae93-ec7ece296df7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:46.114447 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3c6b4e77-5827-4c17-ae93-ec7ece296df7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:46.195841 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2414df6e-4195-46cc-b69f-b142324b3cbc tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:46.197102 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2414df6e-4195-46cc-b69f-b142324b3cbc tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:46.203754 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2414df6e-4195-46cc-b69f-b142324b3cbc tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:46.204203 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2414df6e-4195-46cc-b69f-b142324b3cbc tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:46.205013 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2414df6e-4195-46cc-b69f-b142324b3cbc tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:46.205453 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2414df6e-4195-46cc-b69f-b142324b3cbc tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:46.385095 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3c6b4e77-5827-4c17-ae93-ec7ece296df7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:46.394083 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3c6b4e77-5827-4c17-ae93-ec7ece296df7 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1505 microversion: 2.1 time: 0.292599 Jun 23 20:09:46.395135 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 196/383] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:46 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:46.399725 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-bb6817e8-d106-46f2-ac79-f9a1a4ab0b11 req-519d8c65-351d-40c8-a4cd-18fcb5ee98d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016c369d-730c-4b2e-8684-a36248eaad41", "tag": "f2df86e0-0194-46d3-bf6c-c3adbbe5a331"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:46.407923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-bb6817e8-d106-46f2-ac79-f9a1a4ab0b11 req-519d8c65-351d-40c8-a4cd-18fcb5ee98d6 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:46.408513 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-bb6817e8-d106-46f2-ac79-f9a1a4ab0b11 req-519d8c65-351d-40c8-a4cd-18fcb5ee98d6 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:46.421863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-bb6817e8-d106-46f2-ac79-f9a1a4ab0b11 req-519d8c65-351d-40c8-a4cd-18fcb5ee98d6 service nova] Creating event network-changed:f2df86e0-0194-46d3-bf6c-c3adbbe5a331 for instance 016c369d-730c-4b2e-8684-a36248eaad41 on hv-cinder-84727 Jun 23 20:09:46.428003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-bb6817e8-d106-46f2-ac79-f9a1a4ab0b11 req-519d8c65-351d-40c8-a4cd-18fcb5ee98d6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031559 Jun 23 20:09:46.429007 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 197/384] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:46.444009 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2414df6e-4195-46cc-b69f-b142324b3cbc tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:46.456381 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2414df6e-4195-46cc-b69f-b142324b3cbc tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.260498 Jun 23 20:09:46.456381 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 188/385] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:46 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:46.783746 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:46.784694 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:46.793209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:46.793792 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:46.794569 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:46.795310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:46.955966 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:46.964393 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:46.965929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:46.967143 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5e1b2ae3-f624-4336-b2bf-d2b250dd7ebe tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1722 microversion: 2.20 time: 0.187763 Jun 23 20:09:46.967689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 198/386] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:46 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:47.410933 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-24915453-e5c9-4688-8aa0-719d416e87c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:47.411628 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-24915453-e5c9-4688-8aa0-719d416e87c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:47.418205 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24915453-e5c9-4688-8aa0-719d416e87c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:47.418682 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24915453-e5c9-4688-8aa0-719d416e87c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:47.419471 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24915453-e5c9-4688-8aa0-719d416e87c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:47.419905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-24915453-e5c9-4688-8aa0-719d416e87c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:47.468874 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e392f13a-f6a5-48ac-9ce2-efd8eb1aec46 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:47.469881 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e392f13a-f6a5-48ac-9ce2-efd8eb1aec46 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:47.478025 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e392f13a-f6a5-48ac-9ce2-efd8eb1aec46 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:47.478919 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e392f13a-f6a5-48ac-9ce2-efd8eb1aec46 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:47.479689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e392f13a-f6a5-48ac-9ce2-efd8eb1aec46 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:47.480123 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e392f13a-f6a5-48ac-9ce2-efd8eb1aec46 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:47.708286 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:47.737190 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=6 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:47.746864 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-24915453-e5c9-4688-8aa0-719d416e87c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:47.756610 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-24915453-e5c9-4688-8aa0-719d416e87c5 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1505 microversion: 2.1 time: 0.349335 Jun 23 20:09:47.763619 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 189/387] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:47 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:47.763915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e392f13a-f6a5-48ac-9ce2-efd8eb1aec46 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:47.771702 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e392f13a-f6a5-48ac-9ce2-efd8eb1aec46 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.307080 Jun 23 20:09:47.775839 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 199/388] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:47 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:47.986343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:47.987050 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:47.998130 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:47.998587 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:47.999740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:48.000062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:48.255578 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:48.263585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:48.265217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:48.266466 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0eca7957-08a5-41eb-81b4-7e5add12154b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1725 microversion: 2.20 time: 0.285098 Jun 23 20:09:48.267017 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 190/389] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:47 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:48.284959 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3641f2b2-24a8-456c-84da-b407274908a9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42a6cfdc-e708-4932-b483-9c84350b46ce"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:48.286724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3641f2b2-24a8-456c-84da-b407274908a9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:48.296165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3641f2b2-24a8-456c-84da-b407274908a9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:48.296649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3641f2b2-24a8-456c-84da-b407274908a9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:48.297434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3641f2b2-24a8-456c-84da-b407274908a9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:48.297869 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3641f2b2-24a8-456c-84da-b407274908a9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:48.444543 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-63d376d5-3d8d-44b5-bdf7-02c3a396d48a req-0ee62731-5249-4006-b652-86bb6cd18814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a9a669-c9d7-46c6-a901-1e5b99c820e2", "name": "network-vif-deleted", "tag": "71746899-262d-4424-8ec8-9692c4396671"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:48.453539 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-63d376d5-3d8d-44b5-bdf7-02c3a396d48a req-0ee62731-5249-4006-b652-86bb6cd18814 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:48.454098 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-63d376d5-3d8d-44b5-bdf7-02c3a396d48a req-0ee62731-5249-4006-b652-86bb6cd18814 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:48.465669 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-63d376d5-3d8d-44b5-bdf7-02c3a396d48a req-0ee62731-5249-4006-b652-86bb6cd18814 service nova] Creating event network-vif-deleted:71746899-262d-4424-8ec8-9692c4396671 for instance b9a9a669-c9d7-46c6-a901-1e5b99c820e2 on hv-cinder-84727 Jun 23 20:09:48.470849 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-63d376d5-3d8d-44b5-bdf7-02c3a396d48a req-0ee62731-5249-4006-b652-86bb6cd18814 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030255 Jun 23 20:09:48.471586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 191/390] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:09:48.774642 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d204b6e2-0550-4985-9a7c-a069108f1f6d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:48.775340 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d204b6e2-0550-4985-9a7c-a069108f1f6d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:48.781813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d204b6e2-0550-4985-9a7c-a069108f1f6d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:48.782291 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d204b6e2-0550-4985-9a7c-a069108f1f6d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:48.783201 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d204b6e2-0550-4985-9a7c-a069108f1f6d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:48.783652 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d204b6e2-0550-4985-9a7c-a069108f1f6d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:48.851271 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d204b6e2-0550-4985-9a7c-a069108f1f6d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:48.859066 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d204b6e2-0550-4985-9a7c-a069108f1f6d tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1463 microversion: 2.1 time: 0.089138 Jun 23 20:09:48.859628 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 192/391] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:48 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1463 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:48.864130 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e9419ace-8dad-4e81-be1b-5f3a54139ffa tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:48.865001 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e9419ace-8dad-4e81-be1b-5f3a54139ffa tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:48.871525 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e9419ace-8dad-4e81-be1b-5f3a54139ffa tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:48.872083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e9419ace-8dad-4e81-be1b-5f3a54139ffa tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:48.873009 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e9419ace-8dad-4e81-be1b-5f3a54139ffa tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:48.873508 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e9419ace-8dad-4e81-be1b-5f3a54139ffa tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:49.028286 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e9419ace-8dad-4e81-be1b-5f3a54139ffa tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:49.035770 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e9419ace-8dad-4e81-be1b-5f3a54139ffa tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.175189 Jun 23 20:09:49.039806 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 193/392] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:48 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:49.300231 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=4 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:49.645130 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3641f2b2-24a8-456c-84da-b407274908a9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.364416 Jun 23 20:09:49.645740 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 200/393] 10.222.0.44 () {62 vars in 1363 bytes} [Thu Jun 23 20:09:48 2022] POST /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments => generated 188 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 20:09:49.758204 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a8e1cba3-293e-4016-a207-aac5e71e3e4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:49.758771 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a8e1cba3-293e-4016-a207-aac5e71e3e4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:49.765351 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8e1cba3-293e-4016-a207-aac5e71e3e4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:49.765801 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8e1cba3-293e-4016-a207-aac5e71e3e4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:49.766556 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8e1cba3-293e-4016-a207-aac5e71e3e4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:49.766992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8e1cba3-293e-4016-a207-aac5e71e3e4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:49.875653 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:49.876704 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:49.882692 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:49.883128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:49.884036 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:49.884642 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:49.916343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:49.916806 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:49.917260 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lazy-loading 'fault' on Instance uuid b9a9a669-c9d7-46c6-a901-1e5b99c820e2 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:09:49.961965 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a6e5f6e5f24ba89ca4895aebe158f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7d693ea21441559f4db447f5414f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:49.970566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-805ed971-5487-4a05-bb28-63d6190e9598 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 200 len: 1304 microversion: 2.1 time: 0.099055 Jun 23 20:09:49.971133 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 201/394] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:49 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:50.013510 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a8e1cba3-293e-4016-a207-aac5e71e3e4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/action" status: 202 len: 0 microversion: 2.20 time: 0.259208 Jun 23 20:09:50.014026 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 194/395] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jun 23 20:09:49 2022] POST /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:09:50.023036 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:50.023730 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:50.031426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:50.031870 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:50.032709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:50.033138 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:50.058366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3822803d-2b76-45ed-91a2-0dfb81be6e4f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:50.058366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3822803d-2b76-45ed-91a2-0dfb81be6e4f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:50.063586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3822803d-2b76-45ed-91a2-0dfb81be6e4f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:50.064050 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3822803d-2b76-45ed-91a2-0dfb81be6e4f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:50.066669 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3822803d-2b76-45ed-91a2-0dfb81be6e4f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:50.069135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3822803d-2b76-45ed-91a2-0dfb81be6e4f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:50.239016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:50.249516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:50.251172 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:50.252520 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8fa49194-c39d-4871-980d-aaa6c57a4871 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1751 microversion: 2.20 time: 0.233967 Jun 23 20:09:50.253183 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 202/396] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:50 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1751 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:50.263905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3822803d-2b76-45ed-91a2-0dfb81be6e4f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:50.272770 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3822803d-2b76-45ed-91a2-0dfb81be6e4f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.222011 Jun 23 20:09:50.283005 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 195/397] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:50 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:50.988159 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:50.990104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] [instance: b9a9a669-c9d7-46c6-a901-1e5b99c820e2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:50.996075 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:50.996547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:50.997299 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:50.997727 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:51.011621 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] HTTP exception thrown: Instance b9a9a669-c9d7-46c6-a901-1e5b99c820e2 could not be found. Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Request method failure captured: Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 HTTP/1.1 Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMhMFKk9i7FG822yQS16oTvvt8-cC1QyEqhmXgXKkqDpKj0CKwv8d5p4RRfSA0wvSi-amZUyYWgwtlJLNsv0jh1beaAJ2IACBkBEJk3oqm3bvIp9LimrhoczAxHYUOnwVzf4tNa44upfWDB5bBHyTTVj1QhIKkiXCQXIP28fO_PzUdg Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: df7d693ea21441559f4db447f5414f69 Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-VolumesActionsTest-1992940749 Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:09:51.013340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_df7d693ea21441559f4db447f5414f69", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df7d693ea21441559f4db447f5414f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/df7d693ea21441559f4db447f5414f69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/df7d693ea21441559f4db447f5414f69"}]}] Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-VolumesActionsTest-1992940749 Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: df7d693ea21441559f4db447f5414f69 Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-VolumesActionsTest-1992940749 Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-VolumesActionsTest-1992940749-project Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: a6a6e5f6e5f24ba89ca4895aebe158f8 Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-VolumesActionsTest-1992940749-project Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance b9a9a669-c9d7-46c6-a901-1e5b99c820e2 could not be found. Jun 23 20:09:51.015101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'b9a9a669-c9d7-46c6-a901-1e5b99c820e2'} Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a9a669-c9d7-46c6-a901-1e5b99c820e2 could not be found. Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:09:51.016108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a9a669-c9d7-46c6-a901-1e5b99c820e2 could not be found. Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a9a669-c9d7-46c6-a901-1e5b99c820e2 could not be found. Jun 23 20:09:51.019950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:09:51.021033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] Returning 404 to user: Instance b9a9a669-c9d7-46c6-a901-1e5b99c820e2 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:09:51.021033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-59ec9615-8494-4420-b652-b27dd5e4c179 tempest-VolumesActionsTest-1992940749 tempest-VolumesActionsTest-1992940749-project] 10.222.0.44 "GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2" status: 404 len: 111 microversion: 2.1 time: 0.030442 Jun 23 20:09:51.021033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 203/398] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:50 2022] GET /compute/v2.1/servers/b9a9a669-c9d7-46c6-a901-1e5b99c820e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:09:51.271713 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:51.272445 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:51.278899 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:51.279339 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:51.280090 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:51.280548 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:51.291158 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1ba3f308-1b89-4143-88de-bf7867149ff9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:51.291768 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1ba3f308-1b89-4143-88de-bf7867149ff9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:51.300772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1ba3f308-1b89-4143-88de-bf7867149ff9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:51.301513 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1ba3f308-1b89-4143-88de-bf7867149ff9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:51.302444 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1ba3f308-1b89-4143-88de-bf7867149ff9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:51.303152 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1ba3f308-1b89-4143-88de-bf7867149ff9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:51.512249 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1ba3f308-1b89-4143-88de-bf7867149ff9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:51.516665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:51.520379 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1ba3f308-1b89-4143-88de-bf7867149ff9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.233396 Jun 23 20:09:51.520947 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 204/399] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:51 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:09:51.527792 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:51.529452 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:51.530596 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b03a7856-f568-402a-9b79-f9e9b39eebff tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1751 microversion: 2.20 time: 0.263443 Jun 23 20:09:51.531136 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 196/400] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:51 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1751 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:52.538008 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c5de27e6-c2eb-434e-ae8f-6f496835b523 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:52.538607 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c5de27e6-c2eb-434e-ae8f-6f496835b523 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:52.544812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c5de27e6-c2eb-434e-ae8f-6f496835b523 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:52.545250 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c5de27e6-c2eb-434e-ae8f-6f496835b523 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:52.546002 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c5de27e6-c2eb-434e-ae8f-6f496835b523 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:52.546436 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c5de27e6-c2eb-434e-ae8f-6f496835b523 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:52.549942 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:52.550556 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:52.557540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:52.558000 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:52.558763 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:52.559197 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:52.563303 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:52.843881 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c5de27e6-c2eb-434e-ae8f-6f496835b523 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:52.851257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c5de27e6-c2eb-434e-ae8f-6f496835b523 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.317564 Jun 23 20:09:52.857387 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 205/401] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:52 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:52.857641 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:52.866329 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:52.868061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:52.869228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2cbad614-3078-4891-88d6-aa1fc7e07fef tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1753 microversion: 2.20 time: 0.323309 Jun 23 20:09:52.869777 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 197/402] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:52 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1753 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:53.867798 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-cd7b429a-69a5-4c9a-a028-800b4fabd3e2 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:53.868422 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-cd7b429a-69a5-4c9a-a028-800b4fabd3e2 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:53.874494 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cd7b429a-69a5-4c9a-a028-800b4fabd3e2 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:53.874941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cd7b429a-69a5-4c9a-a028-800b4fabd3e2 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:53.875703 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cd7b429a-69a5-4c9a-a028-800b4fabd3e2 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:53.876135 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cd7b429a-69a5-4c9a-a028-800b4fabd3e2 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:53.887801 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:53.888465 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:53.895565 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:53.896691 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:53.897454 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:53.897885 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:54.057122 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-cd7b429a-69a5-4c9a-a028-800b4fabd3e2 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:54.065025 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-cd7b429a-69a5-4c9a-a028-800b4fabd3e2 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.201052 Jun 23 20:09:54.065592 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 206/403] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:53 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:54.080609 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:54.089514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:54.090994 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:54.092128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-43a78116-cdfe-441f-bc7e-86cd9c0b550e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1753 microversion: 2.20 time: 0.208148 Jun 23 20:09:54.092700 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 198/404] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:53 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:54.868446 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-c7427962-77fc-4f91-a429-804fcb58718a req-acbac87f-dbb5-4286-9e77-80159f6f1d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016c369d-730c-4b2e-8684-a36248eaad41", "name": "network-vif-plugged", "status": "completed", "tag": "f2df86e0-0194-46d3-bf6c-c3adbbe5a331"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:09:54.871955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:54.877530 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c7427962-77fc-4f91-a429-804fcb58718a req-acbac87f-dbb5-4286-9e77-80159f6f1d7d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:54.878007 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c7427962-77fc-4f91-a429-804fcb58718a req-acbac87f-dbb5-4286-9e77-80159f6f1d7d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:54.882146 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:09:54.889414 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-c7427962-77fc-4f91-a429-804fcb58718a req-acbac87f-dbb5-4286-9e77-80159f6f1d7d service nova] Creating event network-vif-plugged:f2df86e0-0194-46d3-bf6c-c3adbbe5a331 for instance 016c369d-730c-4b2e-8684-a36248eaad41 on hv-cinder-84727 Jun 23 20:09:54.894515 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-c7427962-77fc-4f91-a429-804fcb58718a req-acbac87f-dbb5-4286-9e77-80159f6f1d7d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030286 Jun 23 20:09:54.895163 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 207/405] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:09:55.081272 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-eeae30d4-f337-4e66-868b-746d9695b2e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:55.081881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-eeae30d4-f337-4e66-868b-746d9695b2e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:55.088894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eeae30d4-f337-4e66-868b-746d9695b2e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:55.089342 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eeae30d4-f337-4e66-868b-746d9695b2e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:55.090095 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eeae30d4-f337-4e66-868b-746d9695b2e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:55.090530 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eeae30d4-f337-4e66-868b-746d9695b2e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:55.110664 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:55.111382 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:55.119210 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:55.119656 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:55.120468 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:55.120901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:55.513262 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-eeae30d4-f337-4e66-868b-746d9695b2e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:55.520737 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-eeae30d4-f337-4e66-868b-746d9695b2e5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.443222 Jun 23 20:09:55.522021 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 199/406] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:55 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:55.534013 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:55.542541 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:55.544036 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:55.545211 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-25cfa489-8726-48b6-8eeb-3ccdd5043b4c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1753 microversion: 2.20 time: 0.438851 Jun 23 20:09:55.545762 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 208/407] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:55 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1753 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:09:56.538918 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6ac45dc4-a633-4643-956c-5227cfcec9c9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:56.539465 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6ac45dc4-a633-4643-956c-5227cfcec9c9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:56.546681 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ac45dc4-a633-4643-956c-5227cfcec9c9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:56.547122 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ac45dc4-a633-4643-956c-5227cfcec9c9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:56.547872 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ac45dc4-a633-4643-956c-5227cfcec9c9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:56.548321 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ac45dc4-a633-4643-956c-5227cfcec9c9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:56.563209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:56.563812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:56.569975 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:56.570424 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:56.571237 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:56.571677 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:56.744740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6ac45dc4-a633-4643-956c-5227cfcec9c9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:56.751366 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:56.752289 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6ac45dc4-a633-4643-956c-5227cfcec9c9 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.217857 Jun 23 20:09:56.757139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 200/408] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:56 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:56.760576 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:56.762114 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:56.763303 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0ae6436c-9ba6-4b5a-be3a-f5a845929f4a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1753 microversion: 2.20 time: 0.204222 Jun 23 20:09:56.763855 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 209/409] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:56 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:57.773430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-33494f25-40fc-4b12-aece-957c53d28893 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:57.774072 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-33494f25-40fc-4b12-aece-957c53d28893 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:57.782448 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:57.783361 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:57.788256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33494f25-40fc-4b12-aece-957c53d28893 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:57.788965 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33494f25-40fc-4b12-aece-957c53d28893 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:57.790335 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33494f25-40fc-4b12-aece-957c53d28893 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:57.791384 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33494f25-40fc-4b12-aece-957c53d28893 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:57.794098 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:57.796787 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:57.797725 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:57.798164 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:58.054717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-33494f25-40fc-4b12-aece-957c53d28893 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:58.057875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:58.066364 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-33494f25-40fc-4b12-aece-957c53d28893 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1315 microversion: 2.1 time: 0.297528 Jun 23 20:09:58.076467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:58.076467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:58.076467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-58b50cfd-1be2-4de5-8868-0b771434897b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1753 microversion: 2.20 time: 0.292610 Jun 23 20:09:58.082475 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 210/410] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:57 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1753 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:58.089999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 201/411] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:57 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:59.084321 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c16fc80f-11ba-404e-b3b2-1152a14c272c tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:59.085862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c16fc80f-11ba-404e-b3b2-1152a14c272c tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:59.091044 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:59.096292 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:59.111516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c16fc80f-11ba-404e-b3b2-1152a14c272c tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:59.113006 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c16fc80f-11ba-404e-b3b2-1152a14c272c tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:59.113658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:59.115573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:59.117432 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c16fc80f-11ba-404e-b3b2-1152a14c272c tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:59.118895 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:59.119619 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c16fc80f-11ba-404e-b3b2-1152a14c272c tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:59.121741 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:59.567025 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c16fc80f-11ba-404e-b3b2-1152a14c272c tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:59.573691 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:59.583324 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c16fc80f-11ba-404e-b3b2-1152a14c272c tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1465 microversion: 2.1 time: 0.501912 Jun 23 20:09:59.584729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 211/412] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:09:59 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1465 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:09:59.585303 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:59.588946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:09:59.590486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a64b8928-16ec-40ee-9da1-5526fcc309b9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.505273 Jun 23 20:09:59.591837 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 202/413] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:09:59 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:09:59.634629 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-308474eb-96b9-49de-8c36-20b189dd50ad tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:09:59.635271 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-308474eb-96b9-49de-8c36-20b189dd50ad tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:09:59.645147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-308474eb-96b9-49de-8c36-20b189dd50ad tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:59.646287 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-308474eb-96b9-49de-8c36-20b189dd50ad tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:59.647585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-308474eb-96b9-49de-8c36-20b189dd50ad tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:09:59.648579 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-308474eb-96b9-49de-8c36-20b189dd50ad tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:09:59.682156 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-308474eb-96b9-49de-8c36-20b189dd50ad tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:10:00.006182 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-308474eb-96b9-49de-8c36-20b189dd50ad tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "DELETE /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 204 len: 0 microversion: 2.1 time: 0.376324 Jun 23 20:10:00.008851 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 212/414] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:09:59 2022] DELETE /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:10:00.023451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-52fec8a3-54d3-45f2-9db0-50ac1a1053b5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:00.024504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-52fec8a3-54d3-45f2-9db0-50ac1a1053b5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:00.036985 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-52fec8a3-54d3-45f2-9db0-50ac1a1053b5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:00.038838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-52fec8a3-54d3-45f2-9db0-50ac1a1053b5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:00.038838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-52fec8a3-54d3-45f2-9db0-50ac1a1053b5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:00.039542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-52fec8a3-54d3-45f2-9db0-50ac1a1053b5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:00.292116 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-52fec8a3-54d3-45f2-9db0-50ac1a1053b5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:00.299833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-52fec8a3-54d3-45f2-9db0-50ac1a1053b5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1471 microversion: 2.1 time: 0.280774 Jun 23 20:10:00.300422 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 203/415] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:00 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:00.609960 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:00.610951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:00.618452 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:00.619211 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:00.620144 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:00.620870 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:00.834886 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:00.847589 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:00.852244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:00.855008 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-36d29c14-5444-469a-baa8-9de2387728cf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.249204 Jun 23 20:10:00.856915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 213/416] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:00 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:01.317943 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f0a6ed19-c533-4bfe-a67c-1a43e397fe81 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:01.323201 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f0a6ed19-c533-4bfe-a67c-1a43e397fe81 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:01.329825 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f0a6ed19-c533-4bfe-a67c-1a43e397fe81 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:01.330586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f0a6ed19-c533-4bfe-a67c-1a43e397fe81 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:01.331711 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f0a6ed19-c533-4bfe-a67c-1a43e397fe81 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:01.332147 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f0a6ed19-c533-4bfe-a67c-1a43e397fe81 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:01.607376 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f0a6ed19-c533-4bfe-a67c-1a43e397fe81 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:01.625490 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f0a6ed19-c533-4bfe-a67c-1a43e397fe81 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1471 microversion: 2.1 time: 0.308134 Jun 23 20:10:01.627691 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 204/417] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:01 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:10:01.877771 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:01.878531 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:01.909327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:01.910726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:01.915494 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:01.918324 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:02.337929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:02.350522 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:02.355071 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:02.357610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-722cc9d6-a1d0-40c3-8740-896f5c5e60ba tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.484767 Jun 23 20:10:02.360111 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 214/418] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:01 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:02.650065 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-96611178-b0f6-4daf-95d5-6d4947e5b3c5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:02.650905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-96611178-b0f6-4daf-95d5-6d4947e5b3c5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:02.659171 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96611178-b0f6-4daf-95d5-6d4947e5b3c5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:02.659627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96611178-b0f6-4daf-95d5-6d4947e5b3c5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:02.660615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96611178-b0f6-4daf-95d5-6d4947e5b3c5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:02.661363 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96611178-b0f6-4daf-95d5-6d4947e5b3c5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:03.023036 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-bcfa147d-6682-46bb-8e18-7cb894a317ef req-88d3a00f-db44-4506-b2c8-9f8394764ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016c369d-730c-4b2e-8684-a36248eaad41", "name": "network-vif-deleted", "tag": "f2df86e0-0194-46d3-bf6c-c3adbbe5a331"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:03.041790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-bcfa147d-6682-46bb-8e18-7cb894a317ef req-88d3a00f-db44-4506-b2c8-9f8394764ed8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:03.042661 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-bcfa147d-6682-46bb-8e18-7cb894a317ef req-88d3a00f-db44-4506-b2c8-9f8394764ed8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:03.044567 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-96611178-b0f6-4daf-95d5-6d4947e5b3c5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:03.052939 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-96611178-b0f6-4daf-95d5-6d4947e5b3c5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1471 microversion: 2.1 time: 0.411783 Jun 23 20:10:03.053549 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 205/419] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:02 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:03.062471 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-bcfa147d-6682-46bb-8e18-7cb894a317ef req-88d3a00f-db44-4506-b2c8-9f8394764ed8 service nova] Creating event network-vif-deleted:f2df86e0-0194-46d3-bf6c-c3adbbe5a331 for instance 016c369d-730c-4b2e-8684-a36248eaad41 on hv-cinder-84727 Jun 23 20:10:03.076820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-bcfa147d-6682-46bb-8e18-7cb894a317ef req-88d3a00f-db44-4506-b2c8-9f8394764ed8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070574 Jun 23 20:10:03.078167 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 215/420] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:10:03.376946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:03.377840 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:03.394780 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:03.395534 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:03.396521 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:03.397653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:03.605636 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:03.615173 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:03.617599 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:03.618838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-48d3ad2d-473f-48e4-8713-7c1211555aa8 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.245912 Jun 23 20:10:03.619401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 206/421] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:03 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:04.075794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:04.076539 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:04.093029 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:04.100716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:04.100716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:04.100716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:04.131348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:04.132104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:04.132996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lazy-loading 'fault' on Instance uuid 016c369d-730c-4b2e-8684-a36248eaad41 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:10:04.189839 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:04.198639 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-484f6923-f229-4dc2-a441-b1899da0ad64 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1305 microversion: 2.1 time: 0.127694 Jun 23 20:10:04.199582 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 216/422] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:04 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:04.638771 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:04.640053 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:04.653344 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:04.654111 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:04.654910 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:04.655500 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:04.916675 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:04.927086 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:04.930392 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:04.931567 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0ea6134d-01d7-4e32-99db-d61ef1cd8675 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.297514 Jun 23 20:10:04.932178 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 207/423] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:04 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:05.216927 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:05.218245 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:05.237149 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:05.238041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:05.239046 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:05.240586 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:05.320734 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:05.325092 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:05.327047 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lazy-loading 'fault' on Instance uuid 016c369d-730c-4b2e-8684-a36248eaad41 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:10:05.417496 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:05.436864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e987b339-ae49-4e4c-9440-d21214ab8128 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1305 microversion: 2.1 time: 0.224068 Jun 23 20:10:05.437806 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 217/424] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:05 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1305 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:05.954618 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:05.955382 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:05.962447 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:05.963112 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:05.964047 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:05.964742 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:06.158373 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:06.168766 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:06.170732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:06.172172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ff0db647-dfd3-4bc4-acb7-a697557416ca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.221756 Jun 23 20:10:06.173345 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 208/425] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:05 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:06.468533 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:06.468533 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:06.498547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:06.498938 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:06.499778 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:06.500225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:06.611646 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:06.612112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:06.612645 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lazy-loading 'fault' on Instance uuid 016c369d-730c-4b2e-8684-a36248eaad41 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:10:06.699897 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:06.714333 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bd3c40b1-b698-4e00-ae85-922c03c4630a tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1305 microversion: 2.1 time: 0.262859 Jun 23 20:10:06.715714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 218/426] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:06 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1305 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:07.191422 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:07.192178 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:07.199035 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:07.199756 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:07.200562 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:07.201004 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:07.340758 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:07.356006 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:07.358404 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:07.358846 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1b2f99c9-3fdf-42c1-8033-970cc523947c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.171733 Jun 23 20:10:07.359631 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 209/427] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:07 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:07.732239 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:07.733884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:07.746697 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:07.747437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:07.748440 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:07.749038 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:07.814348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:07.814806 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:07.818283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lazy-loading 'fault' on Instance uuid 016c369d-730c-4b2e-8684-a36248eaad41 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:10:07.882062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:07.894116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-db36590a-8cfe-41d7-8054-e1958377fe6f tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1305 microversion: 2.1 time: 0.166168 Jun 23 20:10:07.911225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 219/428] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:07 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1305 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:08.383239 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:08.388491 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:08.402323 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:08.403287 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:08.407480 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:08.408243 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:08.599665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:08.619711 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:08.621867 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:08.623124 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0b73fc9a-8e7b-41e0-9f82-b60c72c025c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.248255 Jun 23 20:10:08.642629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 210/429] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:08 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:08.957030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:08.957030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:08.957030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:08.957030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:08.958552 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:08.958552 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:09.052748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:09.053675 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:09.054101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lazy-loading 'fault' on Instance uuid 016c369d-730c-4b2e-8684-a36248eaad41 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:10:09.131098 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:09.141359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-24bd4829-b08c-4200-ac11-8f5796919629 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1305 microversion: 2.1 time: 0.229475 Jun 23 20:10:09.151492 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 220/430] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:08 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1305 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:09.650855 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:09.651668 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:09.660717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:09.661665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:09.663361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:09.664047 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:09.856016 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:09.866971 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:09.869032 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:09.870531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5e427e2f-e178-4027-89a7-d2a7e5a8632f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.226702 Jun 23 20:10:09.882487 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 211/431] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:09 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:10.180570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:10.181873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:10.191796 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:10.192864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:10.194875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:10.195315 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:10.231117 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:10.231490 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:10.231970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lazy-loading 'fault' on Instance uuid 016c369d-730c-4b2e-8684-a36248eaad41 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:10:10.235341 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:10.280089 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3457dad643d34950834cc41462aa412b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee2271744814fe9b2726faa89cfe1bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:10.292625 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-381b5272-fe9d-43db-a619-3216f4e7c3bd tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 200 len: 1305 microversion: 2.1 time: 0.126605 Jun 23 20:10:10.302641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 221/432] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:10 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:10.890134 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:10.891578 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:10.906824 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:10.907615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:10.908638 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:10.909304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:11.082282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:11.093249 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:11.101428 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:11.105524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7b91ca34-685f-484a-bf3d-da5ef119f546 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.219212 Jun 23 20:10:11.108059 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 212/433] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:10 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:11.310866 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:11.312185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] [instance: 016c369d-730c-4b2e-8684-a36248eaad41] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:11.324183 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:11.325211 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:11.326206 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:11.326736 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:11.354295 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] HTTP exception thrown: Instance 016c369d-730c-4b2e-8684-a36248eaad41 could not be found. Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Request method failure captured: Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 HTTP/1.1 Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMh-g82QTQdbsFiN5CXO11O1-MRbnYGDWGIkdL7ZGV7bpUVyAu7TVTsmu13mGTfbEdMyxhErimiBVvobGtw2KOYHLAvWKxItw2rxeNzr76PXY9oneEgCvTQptBVqA2YzrGN82WZkqABL6v95XrBsSFSPz7gFNWyZmy2h94HOvzzZJjQ Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: fee2271744814fe9b2726faa89cfe1bc Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-VolumesNegativeTest-1806558115 Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:10:11.356343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fee2271744814fe9b2726faa89cfe1bc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fee2271744814fe9b2726faa89cfe1bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fee2271744814fe9b2726faa89cfe1bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fee2271744814fe9b2726faa89cfe1bc"}]}] Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-VolumesNegativeTest-1806558115 Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: fee2271744814fe9b2726faa89cfe1bc Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-VolumesNegativeTest-1806558115 Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-VolumesNegativeTest-1806558115-project Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 3457dad643d34950834cc41462aa412b Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-VolumesNegativeTest-1806558115-project Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 016c369d-730c-4b2e-8684-a36248eaad41 could not be found. Jun 23 20:10:11.357689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '016c369d-730c-4b2e-8684-a36248eaad41'} Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016c369d-730c-4b2e-8684-a36248eaad41 could not be found. Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:10:11.358544 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016c369d-730c-4b2e-8684-a36248eaad41 could not be found. Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016c369d-730c-4b2e-8684-a36248eaad41 could not be found. Jun 23 20:10:11.359775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:11.360887 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] Returning 404 to user: Instance 016c369d-730c-4b2e-8684-a36248eaad41 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:10:11.360887 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a7c9af2a-9f78-440e-ac31-35d907dd27f5 tempest-VolumesNegativeTest-1806558115 tempest-VolumesNegativeTest-1806558115-project] 10.222.0.44 "GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41" status: 404 len: 111 microversion: 2.1 time: 0.051145 Jun 23 20:10:11.360887 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 222/434] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:11 2022] GET /compute/v2.1/servers/016c369d-730c-4b2e-8684-a36248eaad41 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:10:12.125516 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:12.126863 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:12.133306 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=68 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:12.135399 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:12.135913 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:12.136942 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:12.137571 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:12.339728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:12.350911 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:12.354640 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:12.356433 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:12.358149 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5473747f-5514-4ba7-9c1d-931d36215f76 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.236498 Jun 23 20:10:12.370478 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 213/435] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:12 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:13.378815 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:13.379451 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:13.386476 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:13.386926 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:13.387688 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:13.388122 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:13.682911 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:13.705213 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:13.706763 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:13.707947 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5559c2b4-c397-4485-ad99-5a1c8792634f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.334273 Jun 23 20:10:13.713486 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 223/436] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:13 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:14.726502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:14.727107 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:14.737238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:14.737238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:14.737238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:14.737238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:14.867638 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:14.876442 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:14.878196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:14.879367 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-404a3439-c00f-4178-b4aa-963d6f7e9e46 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.157298 Jun 23 20:10:14.879909 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 214/437] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:14 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:15.897811 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:15.898333 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:15.904652 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:15.905100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:15.905857 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:15.906456 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:16.042091 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:16.050861 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:16.052379 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:16.053533 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ab1b5a61-09f3-4cdc-be91-ef0b0d573920 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.159975 Jun 23 20:10:16.054089 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 224/438] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:15 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:17.071281 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:17.077346 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:17.078932 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:17.079448 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:17.080221 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:17.080686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:17.210159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:17.218571 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:17.220052 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:17.221224 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3d1decf7-592a-4aa0-8f2f-a1e73a938cca tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.153863 Jun 23 20:10:17.221770 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 215/439] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:17 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:18.239432 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:18.240433 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:18.247070 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:18.247801 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:18.248485 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:18.249134 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:18.395005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:18.405359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:18.407080 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:18.408349 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ad4527e3-c198-463d-a37a-2e1cd333409f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.173214 Jun 23 20:10:18.409121 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 225/440] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:18 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:19.268242 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fd05f80c-ca39-4641-bc24-943c9988ce0b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beb9153b-197c-4f98-ab46-5fd4e592803d"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:19.269516 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fd05f80c-ca39-4641-bc24-943c9988ce0b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:19.281043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fd05f80c-ca39-4641-bc24-943c9988ce0b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:19.281043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fd05f80c-ca39-4641-bc24-943c9988ce0b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:19.281043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fd05f80c-ca39-4641-bc24-943c9988ce0b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:19.281664 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fd05f80c-ca39-4641-bc24-943c9988ce0b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:19.427350 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:19.428076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:19.435388 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:19.437324 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:19.437324 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:19.437324 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:19.579812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:19.588969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:19.590867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:19.592074 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b0a0c16f-f6d6-430a-bc03-c73fa3b8afdc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.168829 Jun 23 20:10:19.592828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 226/441] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:19 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:10:20.141428 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fd05f80c-ca39-4641-bc24-943c9988ce0b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877131 Jun 23 20:10:20.142037 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 216/442] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:10:19 2022] POST /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:10:20.611076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:20.616239 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:20.618168 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:20.618625 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:20.619388 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:20.619825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:20.762032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:20.770699 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:20.772276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:20.774236 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-317baebf-5888-4211-852d-7616fb10e73f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.167213 Jun 23 20:10:20.775045 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 227/443] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:20 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:21.794542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:21.796023 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:21.803297 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:21.803828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:21.805109 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:21.805744 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:21.994465 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:22.012314 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:22.015766 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:22.019161 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9746d652-3d5a-4cfc-8ab2-c3f11e4bb4fb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.229485 Jun 23 20:10:22.024261 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 217/444] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:21 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:23.037813 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:23.039040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:23.045093 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:23.045541 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:23.046299 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:23.046733 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:23.184471 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:23.193917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:23.195409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:23.196605 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d003ae6f-cabb-40e2-8cb8-d3c3fc254a42 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.162778 Jun 23 20:10:23.197168 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 228/445] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:23 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:23.939015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-f3a99bd1-16b8-4840-83a7-73e1f922aa81 req-3168ef37-22d4-42e3-ad7a-3b8714413106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a", "name": "network-vif-plugged", "status": "completed", "tag": "01e605d9-8bd3-4f1a-81cd-9ad85b78e81a"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:23.951404 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f3a99bd1-16b8-4840-83a7-73e1f922aa81 req-3168ef37-22d4-42e3-ad7a-3b8714413106 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:23.951837 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f3a99bd1-16b8-4840-83a7-73e1f922aa81 req-3168ef37-22d4-42e3-ad7a-3b8714413106 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:23.966074 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-f3a99bd1-16b8-4840-83a7-73e1f922aa81 req-3168ef37-22d4-42e3-ad7a-3b8714413106 service nova] Creating event network-vif-plugged:01e605d9-8bd3-4f1a-81cd-9ad85b78e81a for instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a on hv-cinder-84727 Jun 23 20:10:23.971299 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-f3a99bd1-16b8-4840-83a7-73e1f922aa81 req-3168ef37-22d4-42e3-ad7a-3b8714413106 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036673 Jun 23 20:10:23.971905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 218/446] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:10:24.215003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:24.217485 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:24.222009 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:24.222459 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:24.224561 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:24.225255 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:24.360852 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:24.370571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:24.372084 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:24.373333 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-81f82c41-82e2-4d38-87bb-86e8edd1c110 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.162525 Jun 23 20:10:24.373959 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 229/447] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:24 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:25.393682 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:25.394372 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:25.400580 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:25.401028 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:25.401785 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:25.402221 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:25.531725 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:25.550696 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:25.550696 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:25.551012 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-630e46cb-e09e-4227-b48d-4ba076471fe1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.162192 Jun 23 20:10:25.551999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 219/448] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:25 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:26.576693 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:26.577651 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:26.580603 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:26.584141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:26.584649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:26.585376 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:26.585814 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:26.715114 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:26.723365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:26.724880 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:26.726182 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-02c24e7e-f4b0-44c4-8f6b-b32684be80a6 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.153559 Jun 23 20:10:26.726732 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 230/449] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:26 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:27.621758 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2289ea01-ae70-4dde-bb79-25c570b2e398 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:27.622282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2289ea01-ae70-4dde-bb79-25c570b2e398 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:27.632783 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2289ea01-ae70-4dde-bb79-25c570b2e398 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:27.633584 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2289ea01-ae70-4dde-bb79-25c570b2e398 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:27.634951 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2289ea01-ae70-4dde-bb79-25c570b2e398 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:27.635749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2289ea01-ae70-4dde-bb79-25c570b2e398 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:27.662358 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2289ea01-ae70-4dde-bb79-25c570b2e398 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809/ips" status: 200 len: 149 microversion: 2.1 time: 0.044524 Jun 23 20:10:27.663039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 220/450] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:10:27 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:10:27.674576 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cd0e6cd-7c2a-4f52-8938-7468399ad9f4"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:27.675745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:27.683234 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:27.683699 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:27.684547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:27.684995 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:27.745503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:27.746550 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:27.752125 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:27.752608 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:27.753374 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:27.753816 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:27.763653 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Invalid volume: volume 6cd0e6cd-7c2a-4f52-8938-7468399ad9f4 is already attached to instances: c507d545-f924-49b1-91db-92efe489eed7 Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: POST /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809/os-volume_attachments HTTP/1.1 Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 74 Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:10:27.765286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {"volumeAttachment": {"volumeId": "6cd0e6cd-7c2a-4f52-8938-7468399ad9f4"}} Jun 23 20:10:27.766876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Invalid volume: volume 6cd0e6cd-7c2a-4f52-8938-7468399ad9f4 is already attached to instances: c507d545-f924-49b1-91db-92efe489eed7 Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'server_id': 'a4e635b7-eb5c-48a2-9806-5ac7d9f3c809', 'body': {'volumeAttachment': {'volumeId': '6cd0e6cd-7c2a-4f52-8938-7468399ad9f4'}}} Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6cd0e6cd-7c2a-4f52-8938-7468399ad9f4 is already attached to instances: c507d545-f924-49b1-91db-92efe489eed7 Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:27.767755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6cd0e6cd-7c2a-4f52-8938-7468399ad9f4 is already attached to instances: c507d545-f924-49b1-91db-92efe489eed7 Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:27.769067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:27.770284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:27.770284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:10:27.770284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:10:27.770284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6cd0e6cd-7c2a-4f52-8938-7468399ad9f4 is already attached to instances: c507d545-f924-49b1-91db-92efe489eed7 Jun 23 20:10:27.770284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:27.770284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 400 to user: Invalid volume: volume 6cd0e6cd-7c2a-4f52-8938-7468399ad9f4 is already attached to instances: c507d545-f924-49b1-91db-92efe489eed7 {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:10:27.770284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-653fec27-d009-48cf-bdd8-5f5a82367544 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096462 Jun 23 20:10:27.770284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 231/451] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:10:27 2022] POST /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 20:10:27.775459 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7316c5a5-49b5-496b-bb4b-0c0dba70d4cb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:27.775952 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7316c5a5-49b5-496b-bb4b-0c0dba70d4cb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:27.782707 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7316c5a5-49b5-496b-bb4b-0c0dba70d4cb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:27.783155 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7316c5a5-49b5-496b-bb4b-0c0dba70d4cb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:27.783920 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7316c5a5-49b5-496b-bb4b-0c0dba70d4cb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:27.784386 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7316c5a5-49b5-496b-bb4b-0c0dba70d4cb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:27.809568 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7316c5a5-49b5-496b-bb4b-0c0dba70d4cb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:10:27.882278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:27.890600 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:27.892106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:27.893300 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0cdb690e-5b09-4f15-b2cf-d700cf13c937 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.153250 Jun 23 20:10:27.893855 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 221/452] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:27 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:10:28.057986 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7316c5a5-49b5-496b-bb4b-0c0dba70d4cb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 204 len: 0 microversion: 2.1 time: 0.285924 Jun 23 20:10:28.058568 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 232/453] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:10:27 2022] DELETE /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:10:28.066796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b5fbec44-76cb-4abd-a112-7a289c397a87 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:28.067406 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b5fbec44-76cb-4abd-a112-7a289c397a87 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:28.074154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5fbec44-76cb-4abd-a112-7a289c397a87 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:28.074606 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5fbec44-76cb-4abd-a112-7a289c397a87 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:28.075623 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5fbec44-76cb-4abd-a112-7a289c397a87 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:28.076065 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b5fbec44-76cb-4abd-a112-7a289c397a87 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:28.205926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b5fbec44-76cb-4abd-a112-7a289c397a87 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:28.214714 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b5fbec44-76cb-4abd-a112-7a289c397a87 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1680 microversion: 2.1 time: 0.151770 Jun 23 20:10:28.215289 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 222/454] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:28 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:28.912959 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:28.914412 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:28.920502 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:28.920946 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:28.921692 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:28.922122 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:29.054746 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:29.063734 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:29.065239 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:29.066378 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-478be7ce-b2f4-447d-99b8-2d5cad5320f4 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.158024 Jun 23 20:10:29.067011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 233/455] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:28 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:29.233592 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-da70541c-3283-40a5-aec2-72762eccef8f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:29.235410 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-da70541c-3283-40a5-aec2-72762eccef8f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:29.243530 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-da70541c-3283-40a5-aec2-72762eccef8f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:29.243989 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-da70541c-3283-40a5-aec2-72762eccef8f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:29.245044 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-da70541c-3283-40a5-aec2-72762eccef8f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:29.245486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-da70541c-3283-40a5-aec2-72762eccef8f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:29.372956 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-da70541c-3283-40a5-aec2-72762eccef8f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:29.380341 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-da70541c-3283-40a5-aec2-72762eccef8f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1680 microversion: 2.1 time: 0.150920 Jun 23 20:10:29.380901 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 223/456] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:29 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:30.085709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:30.086308 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:30.092840 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:30.097447 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:30.097447 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:30.097447 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:30.399055 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-94eb55c7-eb8f-4006-848f-f8fbf9813f14 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:30.400057 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-94eb55c7-eb8f-4006-848f-f8fbf9813f14 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:30.409748 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-94eb55c7-eb8f-4006-848f-f8fbf9813f14 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:30.410575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-94eb55c7-eb8f-4006-848f-f8fbf9813f14 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:30.411434 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-94eb55c7-eb8f-4006-848f-f8fbf9813f14 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:30.411840 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-94eb55c7-eb8f-4006-848f-f8fbf9813f14 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:30.520556 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:30.529788 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:30.534285 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:30.534285 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2359ae8b-bea1-4fce-b9bb-03ba6e0f2671 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.451067 Jun 23 20:10:30.534285 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 234/457] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:30 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:30.566043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-94eb55c7-eb8f-4006-848f-f8fbf9813f14 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:30.574464 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-94eb55c7-eb8f-4006-848f-f8fbf9813f14 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1680 microversion: 2.1 time: 0.180704 Jun 23 20:10:30.575048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 224/458] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:30 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:31.551013 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:31.551701 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:31.558924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:31.559431 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:31.560257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:31.560791 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:31.592519 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-930b62c7-df10-4067-bf18-d2ee344a0297 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:31.593095 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-930b62c7-df10-4067-bf18-d2ee344a0297 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:31.606480 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-930b62c7-df10-4067-bf18-d2ee344a0297 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:31.607067 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-930b62c7-df10-4067-bf18-d2ee344a0297 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:31.610760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-930b62c7-df10-4067-bf18-d2ee344a0297 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:31.611543 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-930b62c7-df10-4067-bf18-d2ee344a0297 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:31.971828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:31.983953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:31.985584 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:31.986759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d7b5e140-6906-497f-9ca8-0e8f31c71ccb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1809 microversion: 2.20 time: 0.439707 Jun 23 20:10:31.987498 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 235/459] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:31 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1809 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:10:32.013760 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-dd6bd4fd-c640-4709-a452-256aac9ea8d1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:32.018130 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-dd6bd4fd-c640-4709-a452-256aac9ea8d1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:32.035684 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd6bd4fd-c640-4709-a452-256aac9ea8d1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:32.036164 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd6bd4fd-c640-4709-a452-256aac9ea8d1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:32.036970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd6bd4fd-c640-4709-a452-256aac9ea8d1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:32.037105 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-930b62c7-df10-4067-bf18-d2ee344a0297 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:32.037396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd6bd4fd-c640-4709-a452-256aac9ea8d1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:32.044604 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-930b62c7-df10-4067-bf18-d2ee344a0297 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1680 microversion: 2.1 time: 0.456311 Jun 23 20:10:32.045173 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 225/460] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:31 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1680 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:10:32.073895 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-dd6bd4fd-c640-4709-a452-256aac9ea8d1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lazy-loading 'flavor' on Instance uuid 6e5de1ee-6219-48dc-af73-d21b440c9122 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:10:32.089956 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:32.520046 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-dd6bd4fd-c640-4709-a452-256aac9ea8d1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/action" status: 200 len: 32 microversion: 2.1 time: 0.530743 Jun 23 20:10:32.521002 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 236/461] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:10:31 2022] POST /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/action => generated 32 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 20:10:32.532379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a07dd5f1-86fa-46a4-bba8-db6d17b585dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:32.533015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a07dd5f1-86fa-46a4-bba8-db6d17b585dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:32.540354 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a07dd5f1-86fa-46a4-bba8-db6d17b585dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:32.540832 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a07dd5f1-86fa-46a4-bba8-db6d17b585dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:32.541839 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a07dd5f1-86fa-46a4-bba8-db6d17b585dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:32.542287 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a07dd5f1-86fa-46a4-bba8-db6d17b585dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:32.829807 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-2a5458d9-970a-4be1-b54f-64868ffbd4d9 req-88389300-88da-4c3c-980a-57f19fdd4ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e635b7-eb5c-48a2-9806-5ac7d9f3c809", "name": "network-vif-deleted", "tag": "4af33271-c5e4-4644-953f-371408d0d791"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:32.841472 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-2a5458d9-970a-4be1-b54f-64868ffbd4d9 req-88389300-88da-4c3c-980a-57f19fdd4ca3 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:32.842209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-2a5458d9-970a-4be1-b54f-64868ffbd4d9 req-88389300-88da-4c3c-980a-57f19fdd4ca3 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:32.854557 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-2a5458d9-970a-4be1-b54f-64868ffbd4d9 req-88389300-88da-4c3c-980a-57f19fdd4ca3 service nova] Creating event network-vif-deleted:4af33271-c5e4-4644-953f-371408d0d791 for instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 on hv-cinder-84727 Jun 23 20:10:32.859635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-2a5458d9-970a-4be1-b54f-64868ffbd4d9 req-88389300-88da-4c3c-980a-57f19fdd4ca3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034994 Jun 23 20:10:32.860790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 237/462] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:10:32.875335 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a07dd5f1-86fa-46a4-bba8-db6d17b585dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:32.888038 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a07dd5f1-86fa-46a4-bba8-db6d17b585dc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.360570 Jun 23 20:10:32.889329 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 226/463] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:32 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:33.013249 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:33.013949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:33.020805 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:33.021249 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:33.022186 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:33.022660 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:33.062900 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5e8b30c9-ad0b-403e-80fe-19c6730f9cf6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:33.063480 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5e8b30c9-ad0b-403e-80fe-19c6730f9cf6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:33.069914 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e8b30c9-ad0b-403e-80fe-19c6730f9cf6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:33.070426 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e8b30c9-ad0b-403e-80fe-19c6730f9cf6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:33.071878 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e8b30c9-ad0b-403e-80fe-19c6730f9cf6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:33.072335 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5e8b30c9-ad0b-403e-80fe-19c6730f9cf6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:33.179811 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5e8b30c9-ad0b-403e-80fe-19c6730f9cf6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:33.195905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5e8b30c9-ad0b-403e-80fe-19c6730f9cf6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 200 len: 1326 microversion: 2.1 time: 0.135412 Jun 23 20:10:33.199708 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 227/464] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:33 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 1326 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:10:33.283762 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:33.294433 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:33.296269 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:33.297954 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c06728a3-500d-4919-93d8-b1e02e889564 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1796 microversion: 2.20 time: 0.290454 Jun 23 20:10:33.298510 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 238/465] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:10:33 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1796 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:10:33.906162 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2a3f8bed-4075-40e8-8001-f9f1df30e16c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:33.906699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2a3f8bed-4075-40e8-8001-f9f1df30e16c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:33.913379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a3f8bed-4075-40e8-8001-f9f1df30e16c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:33.913828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a3f8bed-4075-40e8-8001-f9f1df30e16c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:33.914598 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a3f8bed-4075-40e8-8001-f9f1df30e16c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:33.916208 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a3f8bed-4075-40e8-8001-f9f1df30e16c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:34.071958 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2a3f8bed-4075-40e8-8001-f9f1df30e16c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:34.080550 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2a3f8bed-4075-40e8-8001-f9f1df30e16c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.178223 Jun 23 20:10:34.081184 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 228/466] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:33 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:34.215182 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:34.215714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:34.221853 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:34.222291 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:34.223034 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:34.223493 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:34.237710 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 HTTP/1.1 Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:10:34.239685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:10:34.241197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'a4e635b7-eb5c-48a2-9806-5ac7d9f3c809'} Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:10:34.242041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:10:34.243511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:10:34.244809 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:10:34.244809 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bbd6e8f1-a0a7-4123-b627-3275716f0d62 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 404 len: 111 microversion: 2.1 time: 0.030149 Jun 23 20:10:34.244809 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 239/467] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:34 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:10:34.250010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e312ce07-5090-42fc-b785-ac71f172ad02 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '.version_select at 0x7f90d9f164c0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:34.339651 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e312ce07-5090-42fc-b785-ac71f172ad02 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-325159526" status: 202 len: 0 microversion: 2.1 time: 0.093395 Jun 23 20:10:34.340223 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 229/468] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 23 20:10:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-325159526 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:10:35.099393 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bb206536-7b42-4556-905e-31a29819f485 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:35.099991 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bb206536-7b42-4556-905e-31a29819f485 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:35.106584 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bb206536-7b42-4556-905e-31a29819f485 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:35.107023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bb206536-7b42-4556-905e-31a29819f485 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:35.107771 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bb206536-7b42-4556-905e-31a29819f485 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:35.108195 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bb206536-7b42-4556-905e-31a29819f485 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:35.142959 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4d6d1e4d-67ff-4676-a5cf-e5ee7e1194c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:35.143471 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4d6d1e4d-67ff-4676-a5cf-e5ee7e1194c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:35.150217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d6d1e4d-67ff-4676-a5cf-e5ee7e1194c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:35.150893 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d6d1e4d-67ff-4676-a5cf-e5ee7e1194c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:35.151665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d6d1e4d-67ff-4676-a5cf-e5ee7e1194c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:35.152104 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d6d1e4d-67ff-4676-a5cf-e5ee7e1194c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:35.237972 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-bb206536-7b42-4556-905e-31a29819f485 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:35.248439 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bb206536-7b42-4556-905e-31a29819f485 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.152930 Jun 23 20:10:35.248996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 240/469] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:35 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:35.280043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-4d6d1e4d-67ff-4676-a5cf-e5ee7e1194c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lazy-loading 'services' on Instance uuid c507d545-f924-49b1-91db-92efe489eed7 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:10:35.315429 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:35.519786 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4d6d1e4d-67ff-4676-a5cf-e5ee7e1194c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments/6cd0e6cd-7c2a-4f52-8938-7468399ad9f4" status: 202 len: 0 microversion: 2.1 time: 0.380926 Jun 23 20:10:35.520354 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 230/470] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:10:35 2022] DELETE /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments/6cd0e6cd-7c2a-4f52-8938-7468399ad9f4 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 20:10:35.530221 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ab3ad367-5469-45a1-a5de-7ebe3e5a4f11 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:35.531196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ab3ad367-5469-45a1-a5de-7ebe3e5a4f11 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:35.537456 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab3ad367-5469-45a1-a5de-7ebe3e5a4f11 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:35.537851 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab3ad367-5469-45a1-a5de-7ebe3e5a4f11 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:35.538609 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab3ad367-5469-45a1-a5de-7ebe3e5a4f11 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:35.539040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab3ad367-5469-45a1-a5de-7ebe3e5a4f11 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:35.568411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ab3ad367-5469-45a1-a5de-7ebe3e5a4f11 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042324 Jun 23 20:10:35.568951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 241/471] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:10:35 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:10:36.266270 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a2a25d5c-ed1b-4f17-a1a9-a71a7e4fd328 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:36.266981 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a2a25d5c-ed1b-4f17-a1a9-a71a7e4fd328 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:36.273342 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2a25d5c-ed1b-4f17-a1a9-a71a7e4fd328 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:36.273789 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2a25d5c-ed1b-4f17-a1a9-a71a7e4fd328 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:36.274545 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2a25d5c-ed1b-4f17-a1a9-a71a7e4fd328 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:36.274977 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2a25d5c-ed1b-4f17-a1a9-a71a7e4fd328 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:36.416030 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a2a25d5c-ed1b-4f17-a1a9-a71a7e4fd328 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:36.423957 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a2a25d5c-ed1b-4f17-a1a9-a71a7e4fd328 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.162321 Jun 23 20:10:36.424548 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 231/472] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:36 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:36.579796 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ce568777-06eb-43c0-9a3d-c3de498562d3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:36.580771 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ce568777-06eb-43c0-9a3d-c3de498562d3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:36.586867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ce568777-06eb-43c0-9a3d-c3de498562d3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:36.587315 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ce568777-06eb-43c0-9a3d-c3de498562d3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:36.588072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ce568777-06eb-43c0-9a3d-c3de498562d3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:36.588568 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ce568777-06eb-43c0-9a3d-c3de498562d3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:36.616950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ce568777-06eb-43c0-9a3d-c3de498562d3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041374 Jun 23 20:10:36.617447 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 242/473] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:10:36 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:10:37.440993 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f75db7f1-ae63-40d5-827e-e6dd4619f951 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:37.441531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f75db7f1-ae63-40d5-827e-e6dd4619f951 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:37.447877 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75db7f1-ae63-40d5-827e-e6dd4619f951 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:37.448340 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75db7f1-ae63-40d5-827e-e6dd4619f951 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:37.449096 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75db7f1-ae63-40d5-827e-e6dd4619f951 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:37.449548 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f75db7f1-ae63-40d5-827e-e6dd4619f951 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:37.576992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f75db7f1-ae63-40d5-827e-e6dd4619f951 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:37.584797 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f75db7f1-ae63-40d5-827e-e6dd4619f951 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.147728 Jun 23 20:10:37.585360 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 232/474] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:37 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:37.630931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-71653d36-b616-470f-8b73-dcfbd0b0ef42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:37.631842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-71653d36-b616-470f-8b73-dcfbd0b0ef42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:37.641731 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71653d36-b616-470f-8b73-dcfbd0b0ef42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:37.642181 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71653d36-b616-470f-8b73-dcfbd0b0ef42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:37.642948 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71653d36-b616-470f-8b73-dcfbd0b0ef42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:37.643381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71653d36-b616-470f-8b73-dcfbd0b0ef42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:37.672425 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-71653d36-b616-470f-8b73-dcfbd0b0ef42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045379 Jun 23 20:10:37.672973 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 243/475] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:10:37 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 20:10:37.735803 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-15f803ab-1133-4bf1-b767-996bfe2e0d6c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:37.736378 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-15f803ab-1133-4bf1-b767-996bfe2e0d6c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:37.742567 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-15f803ab-1133-4bf1-b767-996bfe2e0d6c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:37.743037 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-15f803ab-1133-4bf1-b767-996bfe2e0d6c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:37.743881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-15f803ab-1133-4bf1-b767-996bfe2e0d6c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:37.744336 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-15f803ab-1133-4bf1-b767-996bfe2e0d6c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:37.768949 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-15f803ab-1133-4bf1-b767-996bfe2e0d6c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:10:38.069398 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-15f803ab-1133-4bf1-b767-996bfe2e0d6c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 204 len: 0 microversion: 2.1 time: 0.337318 Jun 23 20:10:38.069996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 233/476] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:10:37 2022] DELETE /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:10:38.078893 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d9c80669-baa1-4781-bd5a-457c2fd1e3e5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:38.079500 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d9c80669-baa1-4781-bd5a-457c2fd1e3e5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:38.085631 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9c80669-baa1-4781-bd5a-457c2fd1e3e5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:38.086073 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9c80669-baa1-4781-bd5a-457c2fd1e3e5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:38.087455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9c80669-baa1-4781-bd5a-457c2fd1e3e5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:38.087899 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9c80669-baa1-4781-bd5a-457c2fd1e3e5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:38.216384 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d9c80669-baa1-4781-bd5a-457c2fd1e3e5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:38.224102 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d9c80669-baa1-4781-bd5a-457c2fd1e3e5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1679 microversion: 2.1 time: 0.149255 Jun 23 20:10:38.224700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 244/477] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:38 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:38.602650 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a48efe9d-874c-4929-97fc-46cf1656ea02 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:38.603343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a48efe9d-874c-4929-97fc-46cf1656ea02 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:38.609786 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a48efe9d-874c-4929-97fc-46cf1656ea02 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:38.610231 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a48efe9d-874c-4929-97fc-46cf1656ea02 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:38.610982 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a48efe9d-874c-4929-97fc-46cf1656ea02 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:38.611417 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a48efe9d-874c-4929-97fc-46cf1656ea02 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:38.747457 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a48efe9d-874c-4929-97fc-46cf1656ea02 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:38.755539 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a48efe9d-874c-4929-97fc-46cf1656ea02 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.157166 Jun 23 20:10:38.758109 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 234/478] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:38 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:39.241427 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-afc124a9-d4e5-4f55-bd11-99b7919f1b88 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:39.242034 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-afc124a9-d4e5-4f55-bd11-99b7919f1b88 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:39.248613 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afc124a9-d4e5-4f55-bd11-99b7919f1b88 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:39.249045 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afc124a9-d4e5-4f55-bd11-99b7919f1b88 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:39.249800 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afc124a9-d4e5-4f55-bd11-99b7919f1b88 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:39.250234 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afc124a9-d4e5-4f55-bd11-99b7919f1b88 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:39.376377 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-afc124a9-d4e5-4f55-bd11-99b7919f1b88 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:39.384318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-afc124a9-d4e5-4f55-bd11-99b7919f1b88 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1679 microversion: 2.1 time: 0.146182 Jun 23 20:10:39.384883 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 245/479] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:39 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:39.773263 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ed13fb8d-d246-49ac-a36b-5df9a4e0d164 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:39.773780 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ed13fb8d-d246-49ac-a36b-5df9a4e0d164 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:39.780395 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ed13fb8d-d246-49ac-a36b-5df9a4e0d164 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:39.780844 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ed13fb8d-d246-49ac-a36b-5df9a4e0d164 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:39.781599 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ed13fb8d-d246-49ac-a36b-5df9a4e0d164 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:39.782114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ed13fb8d-d246-49ac-a36b-5df9a4e0d164 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:39.918231 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ed13fb8d-d246-49ac-a36b-5df9a4e0d164 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:39.926225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ed13fb8d-d246-49ac-a36b-5df9a4e0d164 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.157196 Jun 23 20:10:39.926778 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 235/480] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:39 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:40.402189 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6d778dde-5442-4daf-8266-68c337c59d8c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:40.402790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6d778dde-5442-4daf-8266-68c337c59d8c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:40.408751 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6d778dde-5442-4daf-8266-68c337c59d8c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:40.409197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6d778dde-5442-4daf-8266-68c337c59d8c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:40.409958 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6d778dde-5442-4daf-8266-68c337c59d8c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:40.410389 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6d778dde-5442-4daf-8266-68c337c59d8c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:40.537273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-6d778dde-5442-4daf-8266-68c337c59d8c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:40.544863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6d778dde-5442-4daf-8266-68c337c59d8c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1679 microversion: 2.1 time: 0.147228 Jun 23 20:10:40.545423 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 246/481] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:40 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:40.942882 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e8097535-7f96-45b3-be1e-28bae0167faf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:40.943548 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e8097535-7f96-45b3-be1e-28bae0167faf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:40.950971 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e8097535-7f96-45b3-be1e-28bae0167faf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:40.951416 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e8097535-7f96-45b3-be1e-28bae0167faf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:40.952224 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e8097535-7f96-45b3-be1e-28bae0167faf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:40.952677 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e8097535-7f96-45b3-be1e-28bae0167faf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:41.083749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e8097535-7f96-45b3-be1e-28bae0167faf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:41.092498 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e8097535-7f96-45b3-be1e-28bae0167faf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.153296 Jun 23 20:10:41.093057 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 236/482] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:40 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:41.562516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bbf4a6e3-0f6b-4615-8ec1-d79f0d164699 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:41.563113 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bbf4a6e3-0f6b-4615-8ec1-d79f0d164699 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:41.569175 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bbf4a6e3-0f6b-4615-8ec1-d79f0d164699 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:41.569619 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bbf4a6e3-0f6b-4615-8ec1-d79f0d164699 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:41.570370 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bbf4a6e3-0f6b-4615-8ec1-d79f0d164699 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:41.570801 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bbf4a6e3-0f6b-4615-8ec1-d79f0d164699 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:41.697511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-bbf4a6e3-0f6b-4615-8ec1-d79f0d164699 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:41.706679 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bbf4a6e3-0f6b-4615-8ec1-d79f0d164699 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1679 microversion: 2.1 time: 0.148022 Jun 23 20:10:41.707363 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 247/483] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:41 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:42.109738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cb9d721f-9e53-43c8-b850-2fed0309b705 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:42.110390 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cb9d721f-9e53-43c8-b850-2fed0309b705 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:42.116892 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb9d721f-9e53-43c8-b850-2fed0309b705 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:42.117348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb9d721f-9e53-43c8-b850-2fed0309b705 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:42.118695 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb9d721f-9e53-43c8-b850-2fed0309b705 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:42.119135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cb9d721f-9e53-43c8-b850-2fed0309b705 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:42.572182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cb9d721f-9e53-43c8-b850-2fed0309b705 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:42.580553 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cb9d721f-9e53-43c8-b850-2fed0309b705 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.474581 Jun 23 20:10:42.581125 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 237/484] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:42 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:42.725093 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-cd442f25-42a3-4657-8af1-7169c8ba64fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:42.725702 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-cd442f25-42a3-4657-8af1-7169c8ba64fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:42.731833 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cd442f25-42a3-4657-8af1-7169c8ba64fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:42.732277 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cd442f25-42a3-4657-8af1-7169c8ba64fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:42.733069 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cd442f25-42a3-4657-8af1-7169c8ba64fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:42.733515 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cd442f25-42a3-4657-8af1-7169c8ba64fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:42.958493 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-cd442f25-42a3-4657-8af1-7169c8ba64fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:42.966137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-cd442f25-42a3-4657-8af1-7169c8ba64fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1679 microversion: 2.1 time: 0.244866 Jun 23 20:10:42.971774 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 248/485] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:42 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:43.418959 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-cf4bac25-2755-4b9a-a12b-a0174be11bb4 req-cd9720ad-6c8c-4a56-962b-61910d95794f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c507d545-f924-49b1-91db-92efe489eed7", "name": "network-vif-deleted", "tag": "e2d0d115-8902-4843-bd9b-e0319ca9a623"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:43.427908 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cf4bac25-2755-4b9a-a12b-a0174be11bb4 req-cd9720ad-6c8c-4a56-962b-61910d95794f service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:43.428974 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cf4bac25-2755-4b9a-a12b-a0174be11bb4 req-cd9720ad-6c8c-4a56-962b-61910d95794f service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:43.440905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-cf4bac25-2755-4b9a-a12b-a0174be11bb4 req-cd9720ad-6c8c-4a56-962b-61910d95794f service nova] Creating event network-vif-deleted:e2d0d115-8902-4843-bd9b-e0319ca9a623 for instance c507d545-f924-49b1-91db-92efe489eed7 on hv-cinder-84727 Jun 23 20:10:43.446022 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-cf4bac25-2755-4b9a-a12b-a0174be11bb4 req-cd9720ad-6c8c-4a56-962b-61910d95794f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031310 Jun 23 20:10:43.446723 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 238/486] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:10:43.598470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c05cb838-32c6-4ead-a817-fabd44f9a670 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:43.599066 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c05cb838-32c6-4ead-a817-fabd44f9a670 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:43.606154 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c05cb838-32c6-4ead-a817-fabd44f9a670 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:43.606606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c05cb838-32c6-4ead-a817-fabd44f9a670 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:43.607381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c05cb838-32c6-4ead-a817-fabd44f9a670 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:43.607818 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c05cb838-32c6-4ead-a817-fabd44f9a670 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:43.760433 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c05cb838-32c6-4ead-a817-fabd44f9a670 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:43.768352 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c05cb838-32c6-4ead-a817-fabd44f9a670 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.173749 Jun 23 20:10:43.768919 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 249/487] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:43 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:43.983988 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:43.984988 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:43.992583 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:43.993495 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:43.994266 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:43.994743 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:44.027924 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:44.028393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:44.028853 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lazy-loading 'fault' on Instance uuid c507d545-f924-49b1-91db-92efe489eed7 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:10:44.075112 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:44.083520 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fdf5176c-bfdd-4429-93a6-0910e04adede tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 200 len: 1330 microversion: 2.1 time: 0.103684 Jun 23 20:10:44.084145 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 239/488] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:43 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:44.786424 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ef4329c1-3526-4a06-b355-842d4ecdb306 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:44.787167 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ef4329c1-3526-4a06-b355-842d4ecdb306 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:44.793726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ef4329c1-3526-4a06-b355-842d4ecdb306 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:44.794354 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ef4329c1-3526-4a06-b355-842d4ecdb306 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:44.795728 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ef4329c1-3526-4a06-b355-842d4ecdb306 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:44.796284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ef4329c1-3526-4a06-b355-842d4ecdb306 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:44.934980 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ef4329c1-3526-4a06-b355-842d4ecdb306 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:44.943725 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ef4329c1-3526-4a06-b355-842d4ecdb306 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.161214 Jun 23 20:10:44.944410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 250/489] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:44 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:45.101627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:45.103353 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:45.104727 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:45.109445 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:45.109894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:45.110653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:45.111085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:45.124686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 HTTP/1.1 Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:10:45.126294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:10:45.127781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'c507d545-f924-49b1-91db-92efe489eed7'} Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:10:45.128709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:10:45.130256 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:45.132101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:10:45.132101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1b7eb0a2-1af3-45de-a115-e50a10d2f338 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 404 len: 111 microversion: 2.1 time: 0.030155 Jun 23 20:10:45.132101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 240/490] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:45 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:10:45.138939 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d3774865-6798-4f21-b409-4c1626c2a5f5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '.version_select at 0x7f90da984940>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:45.224254 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d3774865-6798-4f21-b409-4c1626c2a5f5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1566955098" status: 202 len: 0 microversion: 2.1 time: 0.090903 Jun 23 20:10:45.224856 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 251/491] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jun 23 20:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1566955098 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:10:45.962342 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3f94536b-2497-46a4-8083-7192e1835361 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:45.963236 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3f94536b-2497-46a4-8083-7192e1835361 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:45.970182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3f94536b-2497-46a4-8083-7192e1835361 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:45.970779 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3f94536b-2497-46a4-8083-7192e1835361 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:45.971632 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3f94536b-2497-46a4-8083-7192e1835361 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:45.972188 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3f94536b-2497-46a4-8083-7192e1835361 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:46.012969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-338b9ea7-d4bd-4393-83f1-9131791961b9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: .version_select at 0x7f90da7be280>, body: {"keypair": {"name": "tempest-keypair-994307435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbWmT8JA3CFHhO3Y+SGrozq4rboqP6fBf71xu4wY+kPZXsl7xbJziR3hQkvoCBl9w9roYwuG2C1Xp3MKULItMVsYcj3Z9lG5PTrtFnG7KMdM25dz/auS/hBZVwlMuPuRw=="}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:46.031589 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-338b9ea7-d4bd-4393-83f1-9131791961b9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for project bd810755b80346ae9219a2d0c61a8a06. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:10:46.035855 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-338b9ea7-d4bd-4393-83f1-9131791961b9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for user 8a5b19c8c0d44e1f93bb1dea72884cc3 and project bd810755b80346ae9219a2d0c61a8a06. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:10:46.110774 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-338b9ea7-d4bd-4393-83f1-9131791961b9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101451 Jun 23 20:10:46.111298 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 252/492] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:10:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:10:46.118229 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3f94536b-2497-46a4-8083-7192e1835361 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:46.126292 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3f94536b-2497-46a4-8083-7192e1835361 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.168386 Jun 23 20:10:46.126853 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 241/493] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:45 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:47.143717 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ba7c4697-d7a1-4069-89a8-1fe11a1aadcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:47.144378 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ba7c4697-d7a1-4069-89a8-1fe11a1aadcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:47.151299 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ba7c4697-d7a1-4069-89a8-1fe11a1aadcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:47.151839 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ba7c4697-d7a1-4069-89a8-1fe11a1aadcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:47.152732 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ba7c4697-d7a1-4069-89a8-1fe11a1aadcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:47.153167 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ba7c4697-d7a1-4069-89a8-1fe11a1aadcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:47.299005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ba7c4697-d7a1-4069-89a8-1fe11a1aadcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:47.307692 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ba7c4697-d7a1-4069-89a8-1fe11a1aadcb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.168143 Jun 23 20:10:47.308248 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 253/494] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:47 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:48.325001 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cce20ca2-86d1-48a6-9280-f294472f6df2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:48.325601 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cce20ca2-86d1-48a6-9280-f294472f6df2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:48.332547 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cce20ca2-86d1-48a6-9280-f294472f6df2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:48.333030 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cce20ca2-86d1-48a6-9280-f294472f6df2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:48.333762 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cce20ca2-86d1-48a6-9280-f294472f6df2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:48.334191 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cce20ca2-86d1-48a6-9280-f294472f6df2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:48.429411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1883090620", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2163b477-2f70-4f87-a2ba-0f833320ac92"}], "security_groups": [{"name": "tempest-securitygroup--421799087"}], "key_name": "tempest-keypair-994307435", "user_data": "}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:48.466972 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cce20ca2-86d1-48a6-9280-f294472f6df2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:48.476793 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cce20ca2-86d1-48a6-9280-f294472f6df2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.154646 Jun 23 20:10:48.476793 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 242/495] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:48 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:48.530296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] validate_networks() for [('2163b477-2f70-4f87-a2ba-0f833320ac92', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:10:48.891352 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:10:48.891765 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:10:48.892228 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:10:48.892683 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:10:48.893085 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:10:48.902014 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:48.902451 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:48.903232 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:48.903659 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:48.920768 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for project bd810755b80346ae9219a2d0c61a8a06. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:10:48.924719 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for user 8a5b19c8c0d44e1f93bb1dea72884cc3 and project bd810755b80346ae9219a2d0c61a8a06. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:10:48.936232 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:10:48.938477 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:10:49.064636 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5e57e2b0-b8f5-473d-84aa-a40a1346ab98 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.639561 Jun 23 20:10:49.065277 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 254/496] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:10:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 20:10:49.075656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-05c92d96-d22b-40ec-80cb-13e71dba031f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:49.076557 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-05c92d96-d22b-40ec-80cb-13e71dba031f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:49.133418 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-05c92d96-d22b-40ec-80cb-13e71dba031f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:49.140702 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-05c92d96-d22b-40ec-80cb-13e71dba031f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1241 microversion: 2.1 time: 0.069371 Jun 23 20:10:49.141213 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 243/497] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:49 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:49.493958 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-42f1cb29-8c7d-4b1c-bfda-69fca2eaefd7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:49.494595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-42f1cb29-8c7d-4b1c-bfda-69fca2eaefd7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:49.500973 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42f1cb29-8c7d-4b1c-bfda-69fca2eaefd7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:49.501447 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42f1cb29-8c7d-4b1c-bfda-69fca2eaefd7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:49.502210 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42f1cb29-8c7d-4b1c-bfda-69fca2eaefd7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:49.502644 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42f1cb29-8c7d-4b1c-bfda-69fca2eaefd7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:49.637512 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-42f1cb29-8c7d-4b1c-bfda-69fca2eaefd7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:49.641032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:49.645838 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-42f1cb29-8c7d-4b1c-bfda-69fca2eaefd7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.156511 Jun 23 20:10:49.646384 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 255/498] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:49 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:10:50.157366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6ff26273-4faf-46ee-b62d-bd6f3e2e7159 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:50.157885 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6ff26273-4faf-46ee-b62d-bd6f3e2e7159 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:50.164652 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ff26273-4faf-46ee-b62d-bd6f3e2e7159 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:50.165104 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ff26273-4faf-46ee-b62d-bd6f3e2e7159 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:50.165863 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ff26273-4faf-46ee-b62d-bd6f3e2e7159 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:50.166334 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6ff26273-4faf-46ee-b62d-bd6f3e2e7159 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:50.227740 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6ff26273-4faf-46ee-b62d-bd6f3e2e7159 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:50.235476 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6ff26273-4faf-46ee-b62d-bd6f3e2e7159 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1245 microversion: 2.1 time: 0.082043 Jun 23 20:10:50.236037 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 244/499] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:50 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:50.663345 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f780d731-84a3-4b85-92f6-698524f37207 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:50.663928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f780d731-84a3-4b85-92f6-698524f37207 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:50.671522 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f780d731-84a3-4b85-92f6-698524f37207 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:50.671970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f780d731-84a3-4b85-92f6-698524f37207 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:50.672772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f780d731-84a3-4b85-92f6-698524f37207 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:50.673198 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f780d731-84a3-4b85-92f6-698524f37207 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:50.805923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f780d731-84a3-4b85-92f6-698524f37207 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:50.813827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f780d731-84a3-4b85-92f6-698524f37207 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.154678 Jun 23 20:10:50.814435 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 256/500] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:50 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:51.251620 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ed4fc369-c944-4724-be93-e3dd7343d3e2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:51.252400 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ed4fc369-c944-4724-be93-e3dd7343d3e2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:51.259643 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ed4fc369-c944-4724-be93-e3dd7343d3e2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:51.260095 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ed4fc369-c944-4724-be93-e3dd7343d3e2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:51.260886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ed4fc369-c944-4724-be93-e3dd7343d3e2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:51.261373 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ed4fc369-c944-4724-be93-e3dd7343d3e2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:51.323897 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ed4fc369-c944-4724-be93-e3dd7343d3e2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:51.331815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ed4fc369-c944-4724-be93-e3dd7343d3e2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1237 microversion: 2.1 time: 0.084208 Jun 23 20:10:51.332395 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 245/501] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:51 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:51.831510 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-511b9ec8-5c3d-4e11-bf85-a1dfe27fa8f6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:51.832100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-511b9ec8-5c3d-4e11-bf85-a1dfe27fa8f6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:51.838671 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-511b9ec8-5c3d-4e11-bf85-a1dfe27fa8f6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:51.839116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-511b9ec8-5c3d-4e11-bf85-a1dfe27fa8f6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:51.839863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-511b9ec8-5c3d-4e11-bf85-a1dfe27fa8f6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:51.840318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-511b9ec8-5c3d-4e11-bf85-a1dfe27fa8f6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:51.969875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-511b9ec8-5c3d-4e11-bf85-a1dfe27fa8f6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:51.977986 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-511b9ec8-5c3d-4e11-bf85-a1dfe27fa8f6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1733 microversion: 2.1 time: 0.150263 Jun 23 20:10:51.978589 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 257/502] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:51 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:52.348016 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-48b60bcb-aa42-4101-9871-c1b3f0223d2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:52.348696 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-48b60bcb-aa42-4101-9871-c1b3f0223d2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:52.355277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48b60bcb-aa42-4101-9871-c1b3f0223d2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:52.355725 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48b60bcb-aa42-4101-9871-c1b3f0223d2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:52.356527 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48b60bcb-aa42-4101-9871-c1b3f0223d2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:52.356969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-48b60bcb-aa42-4101-9871-c1b3f0223d2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:52.417535 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-48b60bcb-aa42-4101-9871-c1b3f0223d2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:52.424912 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-48b60bcb-aa42-4101-9871-c1b3f0223d2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1293 microversion: 2.1 time: 0.080740 Jun 23 20:10:52.425472 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 246/503] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:52 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:52.995786 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-cbaae056-a6ed-4a6e-9eb3-3fb1e72fc6bb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:52.996397 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-cbaae056-a6ed-4a6e-9eb3-3fb1e72fc6bb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:53.002513 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cbaae056-a6ed-4a6e-9eb3-3fb1e72fc6bb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.002949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cbaae056-a6ed-4a6e-9eb3-3fb1e72fc6bb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.003692 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cbaae056-a6ed-4a6e-9eb3-3fb1e72fc6bb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.004119 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cbaae056-a6ed-4a6e-9eb3-3fb1e72fc6bb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.129923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-cbaae056-a6ed-4a6e-9eb3-3fb1e72fc6bb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:53.138788 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-cbaae056-a6ed-4a6e-9eb3-3fb1e72fc6bb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1713 microversion: 2.1 time: 0.147609 Jun 23 20:10:53.143951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 258/504] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:52 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1713 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:53.245999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:53.245999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:53.252263 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.252733 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.253491 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.253923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.276394 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:53.349182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] HTTP exception thrown: Cannot 'detach_volume' instance 6e5de1ee-6219-48dc-af73-d21b440c9122 while it is in vm_state rescued Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Request method failure captured: Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments/beb9153b-197c-4f98-ab46-5fd4e592803d HTTP/1.1 Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMfyxzsamWYAY4W_HtOHWWevrTKWC8RK4VJTVqs_TfC8PoEejL0VGty_DaRq72Ond_ur5yKbVnIGJB1lU8bRv9C_AbQd_Bs0vATjE74j-5caMuhy7j0rXIoUAsJTnACzMgvQ_haumEiGr9liO6idCPQubzNFUJivCbjspeWNnvni-HA Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:10:53.350674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf37c9d0240b48078038d70f678a93eb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf37c9d0240b48078038d70f678a93eb"}]}] Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: f041449191c94a5ca5a38c29dd146a15 Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:10:53.352187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Cannot 'detach_volume' instance 6e5de1ee-6219-48dc-af73-d21b440c9122 while it is in vm_state rescued Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'server_id': '6e5de1ee-6219-48dc-af73-d21b440c9122', 'id': 'beb9153b-197c-4f98-ab46-5fd4e592803d'} Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6e5de1ee-6219-48dc-af73-d21b440c9122 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:10:53.352888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6e5de1ee-6219-48dc-af73-d21b440c9122 while it is in vm_state rescued Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6e5de1ee-6219-48dc-af73-d21b440c9122 while it is in vm_state rescued Jun 23 20:10:53.354117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:10:53.356555 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Returning 409 to user: Cannot 'detach_volume' instance 6e5de1ee-6219-48dc-af73-d21b440c9122 while it is in vm_state rescued {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:10:53.357403 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b2c4984f-e7c0-4d19-991d-d817b4b045e4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments/beb9153b-197c-4f98-ab46-5fd4e592803d" status: 409 len: 152 microversion: 2.1 time: 0.117295 Jun 23 20:10:53.358005 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 247/505] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:10:53 2022] DELETE /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments/beb9153b-197c-4f98-ab46-5fd4e592803d => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 20:10:53.366799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bc9b3903-8683-4182-9939-2bc598305bb9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:53.367105 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bc9b3903-8683-4182-9939-2bc598305bb9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:53.373439 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bc9b3903-8683-4182-9939-2bc598305bb9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.375437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bc9b3903-8683-4182-9939-2bc598305bb9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.375437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bc9b3903-8683-4182-9939-2bc598305bb9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.375437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bc9b3903-8683-4182-9939-2bc598305bb9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.441157 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f23320db-14e0-436e-a267-5a8840774fda tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:53.441790 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f23320db-14e0-436e-a267-5a8840774fda tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:53.448378 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f23320db-14e0-436e-a267-5a8840774fda tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.448828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f23320db-14e0-436e-a267-5a8840774fda tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.449585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f23320db-14e0-436e-a267-5a8840774fda tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.450020 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f23320db-14e0-436e-a267-5a8840774fda tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.538795 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f23320db-14e0-436e-a267-5a8840774fda tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:53.546779 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f23320db-14e0-436e-a267-5a8840774fda tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1299 microversion: 2.1 time: 0.109444 Jun 23 20:10:53.547327 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 248/506] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:53 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:10:53.580812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bc9b3903-8683-4182-9939-2bc598305bb9 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "POST /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/action" status: 202 len: 0 microversion: 2.1 time: 0.218084 Jun 23 20:10:53.584392 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 259/507] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:10:53 2022] POST /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 20:10:53.591866 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-90ab0d18-b824-4968-831a-6cb285d58bb6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:53.593152 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-90ab0d18-b824-4968-831a-6cb285d58bb6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:53.599521 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-90ab0d18-b824-4968-831a-6cb285d58bb6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.599970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-90ab0d18-b824-4968-831a-6cb285d58bb6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.600954 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-90ab0d18-b824-4968-831a-6cb285d58bb6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:53.601390 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-90ab0d18-b824-4968-831a-6cb285d58bb6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:53.868876 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-90ab0d18-b824-4968-831a-6cb285d58bb6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:53.876905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-90ab0d18-b824-4968-831a-6cb285d58bb6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1721 microversion: 2.1 time: 0.291207 Jun 23 20:10:53.877462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 249/508] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:53 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:54.564676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-dce8a82c-25ef-483d-a3d8-3b4dcc9a19f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:54.566015 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-dce8a82c-25ef-483d-a3d8-3b4dcc9a19f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:54.572955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dce8a82c-25ef-483d-a3d8-3b4dcc9a19f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:54.573401 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dce8a82c-25ef-483d-a3d8-3b4dcc9a19f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:54.574267 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dce8a82c-25ef-483d-a3d8-3b4dcc9a19f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:54.574729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dce8a82c-25ef-483d-a3d8-3b4dcc9a19f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:54.781806 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-dce8a82c-25ef-483d-a3d8-3b4dcc9a19f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:54.789283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-dce8a82c-25ef-483d-a3d8-3b4dcc9a19f9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.229442 Jun 23 20:10:54.789851 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 260/509] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:54 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:54.896732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dc67c1df-2cdf-4b43-b23b-61001398384e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:54.897333 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dc67c1df-2cdf-4b43-b23b-61001398384e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:54.904326 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dc67c1df-2cdf-4b43-b23b-61001398384e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:54.904829 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dc67c1df-2cdf-4b43-b23b-61001398384e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:54.905533 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dc67c1df-2cdf-4b43-b23b-61001398384e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:54.906156 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dc67c1df-2cdf-4b43-b23b-61001398384e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:55.113159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-dc67c1df-2cdf-4b43-b23b-61001398384e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:55.123587 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dc67c1df-2cdf-4b43-b23b-61001398384e tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1721 microversion: 2.1 time: 0.230422 Jun 23 20:10:55.124173 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 250/510] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:54 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:55.345800 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-a81a839a-aab2-4e89-8c88-9a4f36cb2a1a req-6cc08454-0c88-4e6e-a6ff-517efde61c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0dadba6-4a1e-4c0d-8342-b999e026e0da", "tag": "7d7b074f-6236-41b4-80e6-37254c2b5b60"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:55.354974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-a81a839a-aab2-4e89-8c88-9a4f36cb2a1a req-6cc08454-0c88-4e6e-a6ff-517efde61c7b service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:55.356162 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-a81a839a-aab2-4e89-8c88-9a4f36cb2a1a req-6cc08454-0c88-4e6e-a6ff-517efde61c7b service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:55.371616 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-a81a839a-aab2-4e89-8c88-9a4f36cb2a1a req-6cc08454-0c88-4e6e-a6ff-517efde61c7b service nova] Creating event network-changed:7d7b074f-6236-41b4-80e6-37254c2b5b60 for instance a0dadba6-4a1e-4c0d-8342-b999e026e0da on hv-cinder-84727 Jun 23 20:10:55.376871 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-a81a839a-aab2-4e89-8c88-9a4f36cb2a1a req-6cc08454-0c88-4e6e-a6ff-517efde61c7b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034594 Jun 23 20:10:55.377561 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 261/511] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:10:55.806746 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-26a0bf20-0695-48af-8907-8b98e502cfb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:55.807364 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-26a0bf20-0695-48af-8907-8b98e502cfb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:55.813665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26a0bf20-0695-48af-8907-8b98e502cfb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:55.814114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26a0bf20-0695-48af-8907-8b98e502cfb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:55.814864 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26a0bf20-0695-48af-8907-8b98e502cfb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:55.815313 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-26a0bf20-0695-48af-8907-8b98e502cfb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:55.952393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-26a0bf20-0695-48af-8907-8b98e502cfb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:55.960678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-26a0bf20-0695-48af-8907-8b98e502cfb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.157809 Jun 23 20:10:55.961293 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 251/512] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:55 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:56.142165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c8b94f8e-7709-4bdc-a542-24911735c53f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:56.142859 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c8b94f8e-7709-4bdc-a542-24911735c53f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:56.149896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c8b94f8e-7709-4bdc-a542-24911735c53f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:56.150454 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c8b94f8e-7709-4bdc-a542-24911735c53f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:56.151921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c8b94f8e-7709-4bdc-a542-24911735c53f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:56.152603 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c8b94f8e-7709-4bdc-a542-24911735c53f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:56.420708 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c8b94f8e-7709-4bdc-a542-24911735c53f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:56.429016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c8b94f8e-7709-4bdc-a542-24911735c53f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1721 microversion: 2.1 time: 0.291009 Jun 23 20:10:56.429635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 262/513] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:56 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1721 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:56.977381 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0c470cc6-deea-4412-a70e-d7ed529419ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:56.977982 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0c470cc6-deea-4412-a70e-d7ed529419ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:56.985252 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0c470cc6-deea-4412-a70e-d7ed529419ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:56.985789 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0c470cc6-deea-4412-a70e-d7ed529419ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:56.986546 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0c470cc6-deea-4412-a70e-d7ed529419ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:56.986975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0c470cc6-deea-4412-a70e-d7ed529419ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:57.209448 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0c470cc6-deea-4412-a70e-d7ed529419ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:57.220852 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0c470cc6-deea-4412-a70e-d7ed529419ed tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.247227 Jun 23 20:10:57.221504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 252/514] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:56 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:57.445566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-27767a5f-1192-4739-9708-ec09dfe8056f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:57.446879 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-27767a5f-1192-4739-9708-ec09dfe8056f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:57.449558 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:57.455862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-27767a5f-1192-4739-9708-ec09dfe8056f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:57.461820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-27767a5f-1192-4739-9708-ec09dfe8056f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:57.461820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-27767a5f-1192-4739-9708-ec09dfe8056f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:57.461820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-27767a5f-1192-4739-9708-ec09dfe8056f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:57.586520 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-27767a5f-1192-4739-9708-ec09dfe8056f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:57.595038 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-27767a5f-1192-4739-9708-ec09dfe8056f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1727 microversion: 2.1 time: 0.153288 Jun 23 20:10:57.595590 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 263/515] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:57 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:57.611161 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-63a5c9ab-8b7a-4f49-99ba-f923735e3ecc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:57.611646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-63a5c9ab-8b7a-4f49-99ba-f923735e3ecc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:57.620631 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-63a5c9ab-8b7a-4f49-99ba-f923735e3ecc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:57.620631 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-63a5c9ab-8b7a-4f49-99ba-f923735e3ecc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:57.620631 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-63a5c9ab-8b7a-4f49-99ba-f923735e3ecc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:57.620631 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-63a5c9ab-8b7a-4f49-99ba-f923735e3ecc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:57.700141 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-63a5c9ab-8b7a-4f49-99ba-f923735e3ecc tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092720 Jun 23 20:10:57.700755 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 253/516] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 23 20:10:57 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:10:58.239301 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0f33ab70-01c9-4302-81d9-a01e25b58d42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:58.240083 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0f33ab70-01c9-4302-81d9-a01e25b58d42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:58.247641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f33ab70-01c9-4302-81d9-a01e25b58d42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:58.248083 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f33ab70-01c9-4302-81d9-a01e25b58d42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:58.248893 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f33ab70-01c9-4302-81d9-a01e25b58d42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:58.249342 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0f33ab70-01c9-4302-81d9-a01e25b58d42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:58.469539 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0f33ab70-01c9-4302-81d9-a01e25b58d42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:58.478298 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0f33ab70-01c9-4302-81d9-a01e25b58d42 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.243520 Jun 23 20:10:58.479184 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 264/517] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:58 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:10:58.728175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-073609f4-3bb5-47ae-a115-751d4c7bef99 req-f4cc6f52-727c-40e0-bd3a-d2a93eecaf1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5de1ee-6219-48dc-af73-d21b440c9122", "tag": "27c60352-48b3-4e75-b043-6c1f57dcdca4"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:10:58.738162 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-073609f4-3bb5-47ae-a115-751d4c7bef99 req-f4cc6f52-727c-40e0-bd3a-d2a93eecaf1c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:58.738602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-073609f4-3bb5-47ae-a115-751d4c7bef99 req-f4cc6f52-727c-40e0-bd3a-d2a93eecaf1c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:58.750698 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-073609f4-3bb5-47ae-a115-751d4c7bef99 req-f4cc6f52-727c-40e0-bd3a-d2a93eecaf1c service nova] Creating event network-changed:27c60352-48b3-4e75-b043-6c1f57dcdca4 for instance 6e5de1ee-6219-48dc-af73-d21b440c9122 on hv-cinder-84727 Jun 23 20:10:58.756607 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-073609f4-3bb5-47ae-a115-751d4c7bef99 req-f4cc6f52-727c-40e0-bd3a-d2a93eecaf1c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032213 Jun 23 20:10:58.761519 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 254/518] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:10:59.494661 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1eebd088-e1ae-4ac1-a1f0-87ba2ec1f86e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:10:59.495287 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1eebd088-e1ae-4ac1-a1f0-87ba2ec1f86e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:10:59.498585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:59.498585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=10 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:10:59.503206 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1eebd088-e1ae-4ac1-a1f0-87ba2ec1f86e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:59.503913 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1eebd088-e1ae-4ac1-a1f0-87ba2ec1f86e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:59.504752 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1eebd088-e1ae-4ac1-a1f0-87ba2ec1f86e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:10:59.505207 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1eebd088-e1ae-4ac1-a1f0-87ba2ec1f86e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:10:59.645159 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1eebd088-e1ae-4ac1-a1f0-87ba2ec1f86e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:10:59.653232 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1eebd088-e1ae-4ac1-a1f0-87ba2ec1f86e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.162064 Jun 23 20:10:59.653527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 265/519] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:10:59 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:00.670227 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2514e443-fd73-4b8a-8fa4-b9264c1a00f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:00.670946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2514e443-fd73-4b8a-8fa4-b9264c1a00f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:00.672915 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:00.678532 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2514e443-fd73-4b8a-8fa4-b9264c1a00f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:00.678972 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2514e443-fd73-4b8a-8fa4-b9264c1a00f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:00.679715 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2514e443-fd73-4b8a-8fa4-b9264c1a00f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:00.680141 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2514e443-fd73-4b8a-8fa4-b9264c1a00f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:00.771897 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-f9111f7c-ce20-4bd9-a920-287769a55cec req-69e60ec3-8681-4d68-b39f-0603ef6141d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5de1ee-6219-48dc-af73-d21b440c9122", "tag": "27c60352-48b3-4e75-b043-6c1f57dcdca4"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:00.780593 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-f9111f7c-ce20-4bd9-a920-287769a55cec req-69e60ec3-8681-4d68-b39f-0603ef6141d9 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:00.781032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-f9111f7c-ce20-4bd9-a920-287769a55cec req-69e60ec3-8681-4d68-b39f-0603ef6141d9 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:00.792740 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-f9111f7c-ce20-4bd9-a920-287769a55cec req-69e60ec3-8681-4d68-b39f-0603ef6141d9 service nova] Creating event network-changed:27c60352-48b3-4e75-b043-6c1f57dcdca4 for instance 6e5de1ee-6219-48dc-af73-d21b440c9122 on hv-cinder-84727 Jun 23 20:11:00.809681 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-f9111f7c-ce20-4bd9-a920-287769a55cec req-69e60ec3-8681-4d68-b39f-0603ef6141d9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041190 Jun 23 20:11:00.810276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 266/520] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:11:00.828715 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2514e443-fd73-4b8a-8fa4-b9264c1a00f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:00.837288 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2514e443-fd73-4b8a-8fa4-b9264c1a00f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.171223 Jun 23 20:11:00.837848 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 255/521] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:00 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:01.855407 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-598eaedb-8df4-4d51-a29a-fdd58796ce2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:01.856095 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-598eaedb-8df4-4d51-a29a-fdd58796ce2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:01.862497 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-598eaedb-8df4-4d51-a29a-fdd58796ce2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:01.862941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-598eaedb-8df4-4d51-a29a-fdd58796ce2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:01.863690 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-598eaedb-8df4-4d51-a29a-fdd58796ce2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:01.864119 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-598eaedb-8df4-4d51-a29a-fdd58796ce2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:01.998236 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-598eaedb-8df4-4d51-a29a-fdd58796ce2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:02.005716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-598eaedb-8df4-4d51-a29a-fdd58796ce2e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.155231 Jun 23 20:11:02.006353 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 267/522] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:01 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:03.023233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-356f6623-5e4d-45f9-be92-3f038f9809db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:03.023815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-356f6623-5e4d-45f9-be92-3f038f9809db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:03.030401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-356f6623-5e4d-45f9-be92-3f038f9809db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:03.030854 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-356f6623-5e4d-45f9-be92-3f038f9809db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:03.031604 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-356f6623-5e4d-45f9-be92-3f038f9809db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:03.032034 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-356f6623-5e4d-45f9-be92-3f038f9809db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:03.160547 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-356f6623-5e4d-45f9-be92-3f038f9809db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:03.168579 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-356f6623-5e4d-45f9-be92-3f038f9809db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.149206 Jun 23 20:11:03.169142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 256/523] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:03 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:04.185736 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-514de09f-e0a3-428e-991b-97356781c6ea tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:04.186335 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-514de09f-e0a3-428e-991b-97356781c6ea tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:04.192462 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-514de09f-e0a3-428e-991b-97356781c6ea tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:04.192910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-514de09f-e0a3-428e-991b-97356781c6ea tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:04.193665 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-514de09f-e0a3-428e-991b-97356781c6ea tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:04.194099 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-514de09f-e0a3-428e-991b-97356781c6ea tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:04.319327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-514de09f-e0a3-428e-991b-97356781c6ea tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:04.327112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-514de09f-e0a3-428e-991b-97356781c6ea tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.145763 Jun 23 20:11:04.327667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 268/524] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:04 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:05.342976 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-73e5e44c-5add-40d7-9064-2cc41b90c39b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:05.343584 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-73e5e44c-5add-40d7-9064-2cc41b90c39b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:05.350181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73e5e44c-5add-40d7-9064-2cc41b90c39b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:05.350637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73e5e44c-5add-40d7-9064-2cc41b90c39b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:05.351398 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73e5e44c-5add-40d7-9064-2cc41b90c39b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:05.351839 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73e5e44c-5add-40d7-9064-2cc41b90c39b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:05.478092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-73e5e44c-5add-40d7-9064-2cc41b90c39b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:05.485629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-73e5e44c-5add-40d7-9064-2cc41b90c39b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.146478 Jun 23 20:11:05.486170 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 257/525] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:05 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:06.023255 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-c802c41f-e46b-4029-ba4a-5f25824dfe24 req-6fc120ce-e5fc-4d09-aebe-ce107b441e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dadba6-4a1e-4c0d-8342-b999e026e0da", "name": "network-vif-plugged", "status": "completed", "tag": "7d7b074f-6236-41b4-80e6-37254c2b5b60"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:06.031707 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c802c41f-e46b-4029-ba4a-5f25824dfe24 req-6fc120ce-e5fc-4d09-aebe-ce107b441e20 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:06.032149 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-c802c41f-e46b-4029-ba4a-5f25824dfe24 req-6fc120ce-e5fc-4d09-aebe-ce107b441e20 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:06.042967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-c802c41f-e46b-4029-ba4a-5f25824dfe24 req-6fc120ce-e5fc-4d09-aebe-ce107b441e20 service nova] Creating event network-vif-plugged:7d7b074f-6236-41b4-80e6-37254c2b5b60 for instance a0dadba6-4a1e-4c0d-8342-b999e026e0da on hv-cinder-84727 Jun 23 20:11:06.047815 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-c802c41f-e46b-4029-ba4a-5f25824dfe24 req-6fc120ce-e5fc-4d09-aebe-ce107b441e20 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028245 Jun 23 20:11:06.048470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 269/526] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:06.503876 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-37c9d56b-eb21-4ba4-8407-64243a761fd3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:06.505397 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-37c9d56b-eb21-4ba4-8407-64243a761fd3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:06.514444 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37c9d56b-eb21-4ba4-8407-64243a761fd3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:06.515054 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37c9d56b-eb21-4ba4-8407-64243a761fd3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:06.516240 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37c9d56b-eb21-4ba4-8407-64243a761fd3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:06.516521 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37c9d56b-eb21-4ba4-8407-64243a761fd3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:06.745796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-37c9d56b-eb21-4ba4-8407-64243a761fd3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:06.753458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-37c9d56b-eb21-4ba4-8407-64243a761fd3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.253851 Jun 23 20:11:06.754016 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 258/527] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:06 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:07.770940 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7042a273-7ff9-4fe1-833b-6b26802d740d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:07.771635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7042a273-7ff9-4fe1-833b-6b26802d740d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:07.778668 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7042a273-7ff9-4fe1-833b-6b26802d740d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:07.779599 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7042a273-7ff9-4fe1-833b-6b26802d740d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:07.780928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7042a273-7ff9-4fe1-833b-6b26802d740d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:07.781388 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7042a273-7ff9-4fe1-833b-6b26802d740d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:07.915128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7042a273-7ff9-4fe1-833b-6b26802d740d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:07.922711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7042a273-7ff9-4fe1-833b-6b26802d740d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.156118 Jun 23 20:11:07.923272 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 270/528] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:07 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:08.938914 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9df4cd72-9058-4db8-a0d1-8b31878169f0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:08.939847 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9df4cd72-9058-4db8-a0d1-8b31878169f0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:08.946308 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9df4cd72-9058-4db8-a0d1-8b31878169f0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:08.946866 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9df4cd72-9058-4db8-a0d1-8b31878169f0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:08.947506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9df4cd72-9058-4db8-a0d1-8b31878169f0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:08.947938 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9df4cd72-9058-4db8-a0d1-8b31878169f0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:09.075995 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9df4cd72-9058-4db8-a0d1-8b31878169f0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:09.083607 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9df4cd72-9058-4db8-a0d1-8b31878169f0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.148571 Jun 23 20:11:09.084165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 259/529] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:08 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:10.100253 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0b837668-2b0d-4a13-b3b4-121b2f6380c4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:10.100888 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0b837668-2b0d-4a13-b3b4-121b2f6380c4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:10.107710 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0b837668-2b0d-4a13-b3b4-121b2f6380c4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:10.108161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0b837668-2b0d-4a13-b3b4-121b2f6380c4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:10.108951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0b837668-2b0d-4a13-b3b4-121b2f6380c4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:10.109388 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0b837668-2b0d-4a13-b3b4-121b2f6380c4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:10.239898 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0b837668-2b0d-4a13-b3b4-121b2f6380c4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:10.247356 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0b837668-2b0d-4a13-b3b4-121b2f6380c4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.150968 Jun 23 20:11:10.247913 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 271/530] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:10 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:11.263968 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-231a6bbd-8f24-4b38-a7f5-87458b695c96 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:11.264596 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-231a6bbd-8f24-4b38-a7f5-87458b695c96 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:11.272461 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-231a6bbd-8f24-4b38-a7f5-87458b695c96 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:11.272921 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-231a6bbd-8f24-4b38-a7f5-87458b695c96 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:11.273874 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-231a6bbd-8f24-4b38-a7f5-87458b695c96 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:11.274316 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-231a6bbd-8f24-4b38-a7f5-87458b695c96 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:11.406820 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-231a6bbd-8f24-4b38-a7f5-87458b695c96 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:11.414416 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-231a6bbd-8f24-4b38-a7f5-87458b695c96 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1366 microversion: 2.1 time: 0.154249 Jun 23 20:11:11.414991 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 260/531] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:11 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:12.431126 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0be7e866-2f0a-4a9b-ac1a-9999392f053e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:12.431745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0be7e866-2f0a-4a9b-ac1a-9999392f053e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:12.438283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0be7e866-2f0a-4a9b-ac1a-9999392f053e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:12.438727 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0be7e866-2f0a-4a9b-ac1a-9999392f053e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:12.439472 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0be7e866-2f0a-4a9b-ac1a-9999392f053e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:12.439898 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0be7e866-2f0a-4a9b-ac1a-9999392f053e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:12.566814 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0be7e866-2f0a-4a9b-ac1a-9999392f053e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:12.574680 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0be7e866-2f0a-4a9b-ac1a-9999392f053e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1555 microversion: 2.1 time: 0.147352 Jun 23 20:11:12.575236 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 272/532] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:12 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:12.592922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-21f83350-32ff-4fe1-be04-ef5c2fc2781d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:12.593480 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-21f83350-32ff-4fe1-be04-ef5c2fc2781d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:12.599837 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21f83350-32ff-4fe1-be04-ef5c2fc2781d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:12.600284 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21f83350-32ff-4fe1-be04-ef5c2fc2781d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:12.601065 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21f83350-32ff-4fe1-be04-ef5c2fc2781d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:12.601501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-21f83350-32ff-4fe1-be04-ef5c2fc2781d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:12.678922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-21f83350-32ff-4fe1-be04-ef5c2fc2781d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090450 Jun 23 20:11:12.679539 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 261/533] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 23 20:11:12 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:13.865768 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-ea418f75-b1cb-4138-ba92-533656f3b253 req-492f94bf-0f74-4497-b3f8-6d5b0f3e73a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0dadba6-4a1e-4c0d-8342-b999e026e0da", "tag": "7d7b074f-6236-41b4-80e6-37254c2b5b60"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:13.873733 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-ea418f75-b1cb-4138-ba92-533656f3b253 req-492f94bf-0f74-4497-b3f8-6d5b0f3e73a8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:13.874173 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-ea418f75-b1cb-4138-ba92-533656f3b253 req-492f94bf-0f74-4497-b3f8-6d5b0f3e73a8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:13.887315 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-ea418f75-b1cb-4138-ba92-533656f3b253 req-492f94bf-0f74-4497-b3f8-6d5b0f3e73a8 service nova] Creating event network-changed:7d7b074f-6236-41b4-80e6-37254c2b5b60 for instance a0dadba6-4a1e-4c0d-8342-b999e026e0da on hv-cinder-84727 Jun 23 20:11:13.892771 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-ea418f75-b1cb-4138-ba92-533656f3b253 req-492f94bf-0f74-4497-b3f8-6d5b0f3e73a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031078 Jun 23 20:11:13.893552 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 273/534] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:20.506863 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a8eacfb7-a3d8-4076-9b36-34cb3cae7340 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:20.507381 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a8eacfb7-a3d8-4076-9b36-34cb3cae7340 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:20.509258 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=46 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:20.514855 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8eacfb7-a3d8-4076-9b36-34cb3cae7340 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:20.515305 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8eacfb7-a3d8-4076-9b36-34cb3cae7340 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:20.516058 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8eacfb7-a3d8-4076-9b36-34cb3cae7340 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:20.516538 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a8eacfb7-a3d8-4076-9b36-34cb3cae7340 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:20.544537 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a8eacfb7-a3d8-4076-9b36-34cb3cae7340 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments/42a6cfdc-e708-4932-b483-9c84350b46ce" status: 200 len: 194 microversion: 2.20 time: 0.042347 Jun 23 20:11:20.545101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 262/535] 10.222.0.44 () {60 vars in 1453 bytes} [Thu Jun 23 20:11:20 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments/42a6cfdc-e708-4932-b483-9c84350b46ce => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 20:11:20.607578 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-75ad1971-94c6-428a-a2c8-2664390fca04 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:20.608145 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-75ad1971-94c6-428a-a2c8-2664390fca04 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:20.614752 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75ad1971-94c6-428a-a2c8-2664390fca04 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:20.615192 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75ad1971-94c6-428a-a2c8-2664390fca04 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:20.616067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75ad1971-94c6-428a-a2c8-2664390fca04 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:20.616536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75ad1971-94c6-428a-a2c8-2664390fca04 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:20.646621 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:20.739279 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-75ad1971-94c6-428a-a2c8-2664390fca04 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lazy-loading 'services' on Instance uuid 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:11:20.978709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-75ad1971-94c6-428a-a2c8-2664390fca04 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "DELETE /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments/42a6cfdc-e708-4932-b483-9c84350b46ce" status: 202 len: 0 microversion: 2.20 time: 0.375575 Jun 23 20:11:20.979291 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 274/536] 10.222.0.44 () {60 vars in 1456 bytes} [Thu Jun 23 20:11:20 2022] DELETE /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments/42a6cfdc-e708-4932-b483-9c84350b46ce => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 20:11:20.988414 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4dfa0795-620c-4e66-b932-9b3d07d2681f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:20.989465 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4dfa0795-620c-4e66-b932-9b3d07d2681f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:20.995781 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4dfa0795-620c-4e66-b932-9b3d07d2681f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:20.996343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4dfa0795-620c-4e66-b932-9b3d07d2681f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:20.997934 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4dfa0795-620c-4e66-b932-9b3d07d2681f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:20.998587 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4dfa0795-620c-4e66-b932-9b3d07d2681f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:21.029063 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4dfa0795-620c-4e66-b932-9b3d07d2681f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044245 Jun 23 20:11:21.029870 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 263/537] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jun 23 20:11:20 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 20:11:22.041079 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-08565549-8155-4bc6-842f-c62b8147069a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:22.042137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-08565549-8155-4bc6-842f-c62b8147069a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:22.048570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-08565549-8155-4bc6-842f-c62b8147069a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:22.049018 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-08565549-8155-4bc6-842f-c62b8147069a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:22.049777 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-08565549-8155-4bc6-842f-c62b8147069a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:22.050217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-08565549-8155-4bc6-842f-c62b8147069a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:22.080711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-08565549-8155-4bc6-842f-c62b8147069a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043869 Jun 23 20:11:22.081257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 275/538] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jun 23 20:11:22 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:11:23.094479 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5779dd90-5a9c-4c7b-a77b-b1df73978375 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:23.095500 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5779dd90-5a9c-4c7b-a77b-b1df73978375 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:23.102138 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5779dd90-5a9c-4c7b-a77b-b1df73978375 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:23.102584 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5779dd90-5a9c-4c7b-a77b-b1df73978375 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:23.103329 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5779dd90-5a9c-4c7b-a77b-b1df73978375 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:23.103756 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5779dd90-5a9c-4c7b-a77b-b1df73978375 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:23.132973 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5779dd90-5a9c-4c7b-a77b-b1df73978375 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042373 Jun 23 20:11:23.133524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 264/539] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jun 23 20:11:23 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:23.189596 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-80848d8f-f72c-4da3-bb3d-dc0f4d9a8a22 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:23.190087 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-80848d8f-f72c-4da3-bb3d-dc0f4d9a8a22 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:23.195912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-80848d8f-f72c-4da3-bb3d-dc0f4d9a8a22 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:23.196454 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-80848d8f-f72c-4da3-bb3d-dc0f4d9a8a22 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:23.197202 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-80848d8f-f72c-4da3-bb3d-dc0f4d9a8a22 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:23.197633 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-80848d8f-f72c-4da3-bb3d-dc0f4d9a8a22 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:23.221437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-80848d8f-f72c-4da3-bb3d-dc0f4d9a8a22 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:11:23.458153 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-80848d8f-f72c-4da3-bb3d-dc0f4d9a8a22 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "DELETE /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 204 len: 0 microversion: 2.20 time: 0.272028 Jun 23 20:11:23.458772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 276/540] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jun 23 20:11:23 2022] DELETE /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 20:11:23.467452 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:23.468223 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:23.474603 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:23.475040 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:23.475784 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:23.476211 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:23.495383 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:23.604575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:23.613060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:23.614589 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:23.615760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-23b48ece-d489-4d24-a071-63081575d7f1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.152746 Jun 23 20:11:23.616319 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 265/541] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:23 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:24.635537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:24.636221 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:24.642830 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:24.643273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:24.644023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:24.644482 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:24.773588 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:24.781398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:24.782899 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:24.784040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-68d357cb-5e66-4eb4-abdf-af9868c3e866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.152812 Jun 23 20:11:24.784640 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 277/542] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:24 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:25.518540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-49f1a0ff-2e98-4894-a586-e025c101a7c1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:25.519047 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-49f1a0ff-2e98-4894-a586-e025c101a7c1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:25.525417 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49f1a0ff-2e98-4894-a586-e025c101a7c1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:25.525865 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49f1a0ff-2e98-4894-a586-e025c101a7c1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:25.526627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49f1a0ff-2e98-4894-a586-e025c101a7c1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:25.527062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49f1a0ff-2e98-4894-a586-e025c101a7c1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:25.553187 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-49f1a0ff-2e98-4894-a586-e025c101a7c1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:11:25.811714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:25.811714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:25.811714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:25.811714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:25.812595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:25.812595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:25.959955 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-49f1a0ff-2e98-4894-a586-e025c101a7c1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "DELETE /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 204 len: 0 microversion: 2.1 time: 0.445559 Jun 23 20:11:25.963634 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 266/543] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:11:25 2022] DELETE /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:11:25.974502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-76b4cd53-a28c-4961-8065-591d9370d101 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:25.974502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-76b4cd53-a28c-4961-8065-591d9370d101 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:25.976887 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76b4cd53-a28c-4961-8065-591d9370d101 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:25.977338 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76b4cd53-a28c-4961-8065-591d9370d101 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:25.978102 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76b4cd53-a28c-4961-8065-591d9370d101 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:25.978566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-76b4cd53-a28c-4961-8065-591d9370d101 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:26.029292 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:26.040077 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:26.041602 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:26.042753 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-77a2534a-df6c-425d-bdd7-70235d15161a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1724 microversion: 2.20 time: 0.245047 Jun 23 20:11:26.043506 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 278/544] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:25 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:11:26.167922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-76b4cd53-a28c-4961-8065-591d9370d101 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:26.176018 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-76b4cd53-a28c-4961-8065-591d9370d101 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1578 microversion: 2.1 time: 0.210809 Jun 23 20:11:26.176641 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 267/545] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:25 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1578 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:26.324255 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-b9c310db-f2d2-430a-9482-1cd058c4f614 req-119d7d77-cf62-4778-b7bb-ff6d20f560f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a", "name": "network-vif-deleted", "tag": "01e605d9-8bd3-4f1a-81cd-9ad85b78e81a"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:26.329969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-b9c310db-f2d2-430a-9482-1cd058c4f614 req-119d7d77-cf62-4778-b7bb-ff6d20f560f2 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:26.330410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-b9c310db-f2d2-430a-9482-1cd058c4f614 req-119d7d77-cf62-4778-b7bb-ff6d20f560f2 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:26.342949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-b9c310db-f2d2-430a-9482-1cd058c4f614 req-119d7d77-cf62-4778-b7bb-ff6d20f560f2 service nova] Creating event network-vif-deleted:01e605d9-8bd3-4f1a-81cd-9ad85b78e81a for instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a on hv-cinder-84727 Jun 23 20:11:26.348433 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-b9c310db-f2d2-430a-9482-1cd058c4f614 req-119d7d77-cf62-4778-b7bb-ff6d20f560f2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031104 Jun 23 20:11:26.349542 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 279/546] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:27.062299 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:27.062908 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:27.069486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:27.069940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:27.070710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:27.071140 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:27.134229 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:27.143530 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:27.145161 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:27.146414 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-984edadb-f439-4303-9308-f029437688bd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1657 microversion: 2.20 time: 0.088736 Jun 23 20:11:27.147057 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 268/547] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:27 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1657 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:27.200845 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e6b1a312-27ee-4d40-9d64-94a5a09f2717 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:27.201541 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e6b1a312-27ee-4d40-9d64-94a5a09f2717 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:27.210217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6b1a312-27ee-4d40-9d64-94a5a09f2717 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:27.210450 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6b1a312-27ee-4d40-9d64-94a5a09f2717 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:27.211217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6b1a312-27ee-4d40-9d64-94a5a09f2717 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:27.211651 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e6b1a312-27ee-4d40-9d64-94a5a09f2717 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:27.352389 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e6b1a312-27ee-4d40-9d64-94a5a09f2717 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:27.360487 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e6b1a312-27ee-4d40-9d64-94a5a09f2717 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1578 microversion: 2.1 time: 0.163976 Jun 23 20:11:27.361052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 280/548] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:27 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:28.164400 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:28.165004 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:28.172062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:28.172534 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:28.173295 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:28.173728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:28.210848 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:28.210848 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:28.210848 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lazy-loading 'fault' on Instance uuid 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:11:28.279923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:28.288262 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:28.289931 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:28.291087 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c0516307-7ba8-40b5-a2fe-921bdad9c56d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 200 len: 1371 microversion: 2.20 time: 0.130666 Jun 23 20:11:28.291783 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 269/549] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:28 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 1371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:28.378196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a5efa1fa-9913-410f-9e55-8e40617ae4f2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:28.379017 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a5efa1fa-9913-410f-9e55-8e40617ae4f2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:28.385382 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a5efa1fa-9913-410f-9e55-8e40617ae4f2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:28.385827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a5efa1fa-9913-410f-9e55-8e40617ae4f2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:28.386578 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a5efa1fa-9913-410f-9e55-8e40617ae4f2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:28.387005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a5efa1fa-9913-410f-9e55-8e40617ae4f2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:28.607662 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a5efa1fa-9913-410f-9e55-8e40617ae4f2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:28.616127 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a5efa1fa-9913-410f-9e55-8e40617ae4f2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1578 microversion: 2.1 time: 0.242374 Jun 23 20:11:28.616917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 281/550] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:28 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:29.312132 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-701f1c64-d9f0-4718-a099-b06748016e05 req-6eb48ac7-278b-4bab-81de-f33a07c108b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200f25e9-8d0e-42eb-91b6-57db370e99e1", "name": "network-vif-deleted", "tag": "34cb6df8-f4a2-46ac-ab20-64414d2a90b1"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:29.317938 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:29.318624 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:29.320671 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:29.321526 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-701f1c64-d9f0-4718-a099-b06748016e05 req-6eb48ac7-278b-4bab-81de-f33a07c108b7 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:29.322028 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-701f1c64-d9f0-4718-a099-b06748016e05 req-6eb48ac7-278b-4bab-81de-f33a07c108b7 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:29.328617 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:29.330380 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:29.330380 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:29.330380 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:29.333829 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-701f1c64-d9f0-4718-a099-b06748016e05 req-6eb48ac7-278b-4bab-81de-f33a07c108b7 service nova] Creating event network-vif-deleted:34cb6df8-f4a2-46ac-ab20-64414d2a90b1 for instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 on hv-cinder-84727 Jun 23 20:11:29.338871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-701f1c64-d9f0-4718-a099-b06748016e05 req-6eb48ac7-278b-4bab-81de-f33a07c108b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031067 Jun 23 20:11:29.339454 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 270/551] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:29.345568 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] HTTP exception thrown: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Request method failure captured: Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a HTTP/1.1 Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMf0uaqil937gcP9xV5ItXVszyMMLKK8K8I9WZpYGIj7HOxDM0dU9Io-OYX5HdM8UFIR86e99io2hy33PTW0ErrLSiKdO96II2lOtkkB7Ua92vV8XYns4szEASvbiUTgl57p-DQbHxhK9M7b2fpXWcKFhg33uA8SbdP4w_Ml3YWO7YM Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:11:29.347348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_71c9cca288b34019947e55d2a3112ddb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/71c9cca288b34019947e55d2a3112ddb"}]}] Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: a3be90df779b4ddb8639d825fcb41234 Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:11:29.349033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a'} Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:11:29.350019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:11:29.351623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:29.353138 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Returning 404 to user: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:11:29.353138 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-eaec779e-c46e-4804-8c7f-eb8c8ad43036 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 404 len: 111 microversion: 2.20 time: 0.038233 Jun 23 20:11:29.353138 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 282/552] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:29 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 20:11:29.358958 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-eda9e512-d1a2-4fd2-b69f-c04709897bcf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '.version_select at 0x7f90d9fda8b0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:29.430881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-eda9e512-d1a2-4fd2-b69f-c04709897bcf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-500894860" status: 204 len: 0 microversion: 2.20 time: 0.075838 Jun 23 20:11:29.431488 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 271/553] 10.222.0.44 () {60 vars in 1258 bytes} [Thu Jun 23 20:11:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-500894860 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 20:11:29.633241 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b0479e5a-59d8-448a-80c5-1a81bb5953a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:29.633844 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b0479e5a-59d8-448a-80c5-1a81bb5953a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:29.640375 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b0479e5a-59d8-448a-80c5-1a81bb5953a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:29.640818 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b0479e5a-59d8-448a-80c5-1a81bb5953a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:29.641567 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b0479e5a-59d8-448a-80c5-1a81bb5953a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:29.641998 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b0479e5a-59d8-448a-80c5-1a81bb5953a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:29.772733 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b0479e5a-59d8-448a-80c5-1a81bb5953a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:29.786918 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b0479e5a-59d8-448a-80c5-1a81bb5953a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 200 len: 1225 microversion: 2.1 time: 0.157658 Jun 23 20:11:29.787864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 283/554] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:29 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:30.248458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9704c75d-bfe2-4396-9c2f-aceddb23a47d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'create', calling method: .version_select at 0x7f90d9ead940>, body: {"keypair": {"name": "tempest-keypair-640274661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT5IX2hWSY1Os0Ic20re0SH1qbCrT612LSVuKD9wkTpjHVnbr7/IF78qNtNrWunOaiiYI8rCOU71JIAH36PTClcUD03g8utahEuT22vOLJ/5ZzAfrq/l1XuP1C9saFT8A=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:30.262161 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-9704c75d-bfe2-4396-9c2f-aceddb23a47d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Getting quotas for project 71c9cca288b34019947e55d2a3112ddb. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:11:30.266028 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-9704c75d-bfe2-4396-9c2f-aceddb23a47d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Getting quotas for user a3be90df779b4ddb8639d825fcb41234 and project 71c9cca288b34019947e55d2a3112ddb. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:11:30.414292 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9704c75d-bfe2-4396-9c2f-aceddb23a47d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.169951 Jun 23 20:11:30.414995 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 272/555] 10.222.0.44 () {62 vars in 1199 bytes} [Thu Jun 23 20:11:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 23 20:11:30.804262 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:30.804966 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:30.814715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:30.814715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:30.814715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:30.814715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:30.827892 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] HTTP exception thrown: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Request method failure captured: Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 HTTP/1.1 Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMghZPttoRRCadsrbFyhVr8Xt9PBJ4ob6CN7M79Wnz7hPCr_NB6A2cqC7wFVIN1bqiGBRO6dauPbjFgGlaBPX0rFtxl9sOM9A1AgSmjACOKkKBvCai7MjZhG8TgIo0U_HTbcR6kxrmT-aYoWedMTiL6r0Z4sRUr7eKhOCN2owatjD4I Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:11:30.829430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_edb569a8b39a437ea8be940df098268c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/edb569a8b39a437ea8be940df098268c"}]}] Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: eafea4329d6243459dd3a6add1e91a2e Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:11:30.830967 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '200f25e9-8d0e-42eb-91b6-57db370e99e1'} Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:11:30.831977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:11:30.833453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:30.834744 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Returning 404 to user: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:11:30.834744 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-35f58df2-7618-40af-872a-cce334a88cd8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 404 len: 111 microversion: 2.1 time: 0.030836 Jun 23 20:11:30.834744 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 284/556] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:30 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:11:30.929751 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-623191052", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-841892012", "security_groups": [{"name": "tempest-secgroup-smoke-1008165961"}], "block_device_mapping_v2": [{"uuid": "1fdc481d-8428-494c-8a1b-796f0bdb8b5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0be33fe-ef21-4463-bb71-a01e82ba375e"}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:31.046331 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] validate_networks() for [('e0be33fe-ef21-4463-bb71-a01e82ba375e', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:11:31.415148 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:11:31.415729 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:11:31.416163 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:11:31.416601 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:11:31.417015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:11:31.426251 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:31.426695 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:31.427485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:31.427921 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:31.445245 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Getting quotas for project edb569a8b39a437ea8be940df098268c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:11:31.449248 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Getting quotas for user eafea4329d6243459dd3a6add1e91a2e and project edb569a8b39a437ea8be940df098268c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:11:31.509866 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:11:31.512192 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fdc481d-8428-494c-8a1b-796f0bdb8b5b',volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:11:31.916482 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8226d6c8-bb7f-4721-acae-d752ac4324c7 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.990515 Jun 23 20:11:31.917133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 273/557] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:11:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:11:31.927501 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-710219f3-6555-441a-aa2e-6b53f5a1caea tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:31.928627 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-710219f3-6555-441a-aa2e-6b53f5a1caea tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:31.998709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-710219f3-6555-441a-aa2e-6b53f5a1caea tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:32.007220 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-710219f3-6555-441a-aa2e-6b53f5a1caea tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1093 microversion: 2.1 time: 0.083979 Jun 23 20:11:32.008163 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 285/558] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:31 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:32.742743 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2127915434", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "692ee610-d0ae-4057-8e1c-c034fd73ff05"}], "security_groups": [{"name": "tempest-securitygroup--1289996393"}], "key_name": "tempest-keypair-640274661", "user_data": "}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:32.840948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] validate_networks() for [('692ee610-d0ae-4057-8e1c-c034fd73ff05', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:11:33.024731 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a9b387be-0723-420d-a3b6-7a84c22912db tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:33.025381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a9b387be-0723-420d-a3b6-7a84c22912db tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:33.031919 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9b387be-0723-420d-a3b6-7a84c22912db tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:33.032654 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9b387be-0723-420d-a3b6-7a84c22912db tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:33.033425 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9b387be-0723-420d-a3b6-7a84c22912db tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:33.033911 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9b387be-0723-420d-a3b6-7a84c22912db tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:33.126260 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a9b387be-0723-420d-a3b6-7a84c22912db tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:33.133867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a9b387be-0723-420d-a3b6-7a84c22912db tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1143 microversion: 2.1 time: 0.113278 Jun 23 20:11:33.134427 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 286/559] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:33 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1143 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:33.236640 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:11:33.237139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:11:33.237836 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:11:33.238327 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:11:33.238929 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:11:33.247585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:33.253504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:33.253504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:33.253504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:33.266684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Getting quotas for project 71c9cca288b34019947e55d2a3112ddb. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:11:33.270324 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Getting quotas for user a3be90df779b4ddb8639d825fcb41234 and project 71c9cca288b34019947e55d2a3112ddb. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:11:33.281011 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:11:33.283153 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:11:33.389639 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c67a3626-9dad-4d2c-a9b1-3af0f9536d13 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.651730 Jun 23 20:11:33.390282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 274/560] 10.222.0.44 () {62 vars in 1187 bytes} [Thu Jun 23 20:11:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 20:11:33.400444 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-81b305d4-0d7e-431b-96b7-4eda08c31cbf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:33.401384 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-81b305d4-0d7e-431b-96b7-4eda08c31cbf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:33.459149 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-81b305d4-0d7e-431b-96b7-4eda08c31cbf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:33.466595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-81b305d4-0d7e-431b-96b7-4eda08c31cbf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:33.469073 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-81b305d4-0d7e-431b-96b7-4eda08c31cbf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:33.470244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-81b305d4-0d7e-431b-96b7-4eda08c31cbf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1281 microversion: 2.20 time: 0.073786 Jun 23 20:11:33.470876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 287/561] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:33 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:34.152225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2ba38d7d-2528-440c-9351-4c1e6c4d7b3a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:34.153075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2ba38d7d-2528-440c-9351-4c1e6c4d7b3a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:34.163171 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ba38d7d-2528-440c-9351-4c1e6c4d7b3a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:34.163865 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ba38d7d-2528-440c-9351-4c1e6c4d7b3a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:34.164727 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ba38d7d-2528-440c-9351-4c1e6c4d7b3a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:34.165164 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ba38d7d-2528-440c-9351-4c1e6c4d7b3a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:34.247102 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2ba38d7d-2528-440c-9351-4c1e6c4d7b3a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:34.254659 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2ba38d7d-2528-440c-9351-4c1e6c4d7b3a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1199 microversion: 2.1 time: 0.107322 Jun 23 20:11:34.255222 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 275/562] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:34 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:34.488183 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:34.488909 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:34.494807 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:34.495267 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:34.496011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:34.496542 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:34.562824 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:34.570785 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:34.572284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:34.573395 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-77935bac-1db2-4c1c-8f51-9619b872e95c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1285 microversion: 2.20 time: 0.089189 Jun 23 20:11:34.573947 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 288/563] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:34 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:35.272273 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1f103767-cd96-4142-8dc6-300fc92f5ce8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:35.272858 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1f103767-cd96-4142-8dc6-300fc92f5ce8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:35.279412 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f103767-cd96-4142-8dc6-300fc92f5ce8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:35.279887 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f103767-cd96-4142-8dc6-300fc92f5ce8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:35.280682 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f103767-cd96-4142-8dc6-300fc92f5ce8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:35.281122 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f103767-cd96-4142-8dc6-300fc92f5ce8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:35.493347 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1f103767-cd96-4142-8dc6-300fc92f5ce8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:35.501959 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1f103767-cd96-4142-8dc6-300fc92f5ce8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1277 microversion: 2.1 time: 0.233333 Jun 23 20:11:35.502326 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 276/564] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:35 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:35.592222 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:35.592866 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:35.598789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:35.599239 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:35.600002 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:35.600464 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:35.691344 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:35.699407 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:35.700936 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:35.702066 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-74f2a59d-6908-4478-bd60-fe43337cc673 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1341 microversion: 2.20 time: 0.113844 Jun 23 20:11:35.702893 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 289/565] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:35 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1341 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:36.199312 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-c7eca154-c39b-47c3-a2af-8818510074dc req-6b5efe2d-9d3c-4068-ae26-6f9898bd1ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d760fb45-e1c6-4ac7-9d84-a507fd45b396", "tag": "0b827b10-c629-4517-9e99-ed82b161fe9d"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:36.209258 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-c7eca154-c39b-47c3-a2af-8818510074dc req-6b5efe2d-9d3c-4068-ae26-6f9898bd1ed4 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:36.209895 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-c7eca154-c39b-47c3-a2af-8818510074dc req-6b5efe2d-9d3c-4068-ae26-6f9898bd1ed4 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:36.231182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-c7eca154-c39b-47c3-a2af-8818510074dc req-6b5efe2d-9d3c-4068-ae26-6f9898bd1ed4 service nova] Creating event network-changed:0b827b10-c629-4517-9e99-ed82b161fe9d for instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 on hv-cinder-84727 Jun 23 20:11:36.243942 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-c7eca154-c39b-47c3-a2af-8818510074dc req-6b5efe2d-9d3c-4068-ae26-6f9898bd1ed4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048079 Jun 23 20:11:36.248205 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 277/566] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:11:36.518820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d6fd6d00-527f-48c8-977a-d238a77075d3 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:36.519458 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d6fd6d00-527f-48c8-977a-d238a77075d3 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:36.525414 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d6fd6d00-527f-48c8-977a-d238a77075d3 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:36.525858 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d6fd6d00-527f-48c8-977a-d238a77075d3 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:36.526616 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d6fd6d00-527f-48c8-977a-d238a77075d3 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:36.527050 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d6fd6d00-527f-48c8-977a-d238a77075d3 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:36.722017 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:36.722709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:36.729903 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:36.732869 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:36.732869 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:36.732869 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:36.785080 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d6fd6d00-527f-48c8-977a-d238a77075d3 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:36.792374 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d6fd6d00-527f-48c8-977a-d238a77075d3 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.277855 Jun 23 20:11:36.792944 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 290/567] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:36 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:37.317536 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:37.325490 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:37.326974 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:37.328511 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-68e048be-a973-40b3-b7ae-c315cd7178cd tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1407 microversion: 2.20 time: 0.611971 Jun 23 20:11:37.329067 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 278/568] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:36 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1407 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:11:37.616533 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fcd74813-5ba9-4463-a265-92956125dba2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:37.617275 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fcd74813-5ba9-4463-a265-92956125dba2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:37.625620 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fcd74813-5ba9-4463-a265-92956125dba2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:37.626298 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fcd74813-5ba9-4463-a265-92956125dba2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:37.627336 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fcd74813-5ba9-4463-a265-92956125dba2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:37.627807 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fcd74813-5ba9-4463-a265-92956125dba2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:37.710492 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-fcd74813-5ba9-4463-a265-92956125dba2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lazy-loading 'services' on Instance uuid 6e5de1ee-6219-48dc-af73-d21b440c9122 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:11:37.808975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4ec35c93-6073-4321-b4a3-7a3693fd4418 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:37.809760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4ec35c93-6073-4321-b4a3-7a3693fd4418 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:37.816824 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ec35c93-6073-4321-b4a3-7a3693fd4418 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:37.817399 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ec35c93-6073-4321-b4a3-7a3693fd4418 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:37.818267 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ec35c93-6073-4321-b4a3-7a3693fd4418 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:37.818820 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ec35c93-6073-4321-b4a3-7a3693fd4418 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:37.859333 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:37.994116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fcd74813-5ba9-4463-a265-92956125dba2 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments/beb9153b-197c-4f98-ab46-5fd4e592803d" status: 202 len: 0 microversion: 2.1 time: 0.384099 Jun 23 20:11:37.994713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 291/569] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:11:37 2022] DELETE /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments/beb9153b-197c-4f98-ab46-5fd4e592803d => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:11:38.005809 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-74c4d542-54dc-411d-841f-55f74e4f578b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:38.007827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-74c4d542-54dc-411d-841f-55f74e4f578b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:38.034646 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-74c4d542-54dc-411d-841f-55f74e4f578b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:38.035112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-74c4d542-54dc-411d-841f-55f74e4f578b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:38.035893 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-74c4d542-54dc-411d-841f-55f74e4f578b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:38.036365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-74c4d542-54dc-411d-841f-55f74e4f578b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:38.074583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-74c4d542-54dc-411d-841f-55f74e4f578b tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074573 Jun 23 20:11:38.077960 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 292/570] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:11:37 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:38.196137 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4ec35c93-6073-4321-b4a3-7a3693fd4418 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:38.204547 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4ec35c93-6073-4321-b4a3-7a3693fd4418 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.399390 Jun 23 20:11:38.207615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 279/571] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:37 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:38.346815 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:38.347418 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:38.354100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:38.354548 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:38.355305 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:38.355740 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:38.490041 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-306a9774-db28-439a-84d9-b9db0057021d req-19de9c36-ea20-46b0-bce5-815edcf1f50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfc5144-0d0f-4d88-bfef-d92a270ca655", "tag": "048e62b5-3005-46cb-96bf-1c13423b57db"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:38.500475 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-306a9774-db28-439a-84d9-b9db0057021d req-19de9c36-ea20-46b0-bce5-815edcf1f50a service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:38.501105 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-306a9774-db28-439a-84d9-b9db0057021d req-19de9c36-ea20-46b0-bce5-815edcf1f50a service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:38.516372 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-306a9774-db28-439a-84d9-b9db0057021d req-19de9c36-ea20-46b0-bce5-815edcf1f50a service nova] Creating event network-changed:048e62b5-3005-46cb-96bf-1c13423b57db for instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 on hv-cinder-84727 Jun 23 20:11:38.521519 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-306a9774-db28-439a-84d9-b9db0057021d req-19de9c36-ea20-46b0-bce5-815edcf1f50a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034964 Jun 23 20:11:38.522727 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 280/572] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:11:38.599844 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:38.608882 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:38.610549 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:38.611716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ffb90fd2-b419-4fcc-af6f-b3efd84bed0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1407 microversion: 2.20 time: 0.268790 Jun 23 20:11:38.612289 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 293/573] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:38 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:39.088597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-37101d60-62a6-42c5-a40d-dde105261b59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:39.090847 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-37101d60-62a6-42c5-a40d-dde105261b59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:39.096066 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37101d60-62a6-42c5-a40d-dde105261b59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:39.096552 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37101d60-62a6-42c5-a40d-dde105261b59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:39.097301 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37101d60-62a6-42c5-a40d-dde105261b59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:39.097727 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-37101d60-62a6-42c5-a40d-dde105261b59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:39.127598 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-37101d60-62a6-42c5-a40d-dde105261b59 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Jun 23 20:11:39.128150 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 281/574] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:11:39 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:39.221143 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1536db59-dfb4-44bd-80c3-f762b4267169 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:39.221925 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1536db59-dfb4-44bd-80c3-f762b4267169 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:39.228079 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1536db59-dfb4-44bd-80c3-f762b4267169 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:39.228692 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1536db59-dfb4-44bd-80c3-f762b4267169 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:39.229458 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1536db59-dfb4-44bd-80c3-f762b4267169 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:39.229896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1536db59-dfb4-44bd-80c3-f762b4267169 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:39.430089 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1536db59-dfb4-44bd-80c3-f762b4267169 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:39.438022 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1536db59-dfb4-44bd-80c3-f762b4267169 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.220808 Jun 23 20:11:39.438580 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 294/575] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:39 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:39.630459 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:39.631090 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:39.637246 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:39.637694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:39.638448 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:39.638881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:39.769450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:39.777574 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:39.779057 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:39.780674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-96a4b11c-45f5-45c7-90e1-0af9e2ac8db0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1407 microversion: 2.20 time: 0.153665 Jun 23 20:11:39.781220 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 282/576] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:39 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:40.138328 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ded0fd9c-7500-421c-8610-c44bfad6a41f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:40.139797 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ded0fd9c-7500-421c-8610-c44bfad6a41f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:40.145892 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ded0fd9c-7500-421c-8610-c44bfad6a41f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.146342 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ded0fd9c-7500-421c-8610-c44bfad6a41f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.147139 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ded0fd9c-7500-421c-8610-c44bfad6a41f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.147523 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ded0fd9c-7500-421c-8610-c44bfad6a41f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.175366 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ded0fd9c-7500-421c-8610-c44bfad6a41f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041008 Jun 23 20:11:40.175902 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 295/577] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:11:40 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 20:11:40.245287 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3b49b7f6-fe15-450f-927b-576f4dadc481 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:40.245818 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3b49b7f6-fe15-450f-927b-576f4dadc481 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:40.252268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3b49b7f6-fe15-450f-927b-576f4dadc481 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.252752 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3b49b7f6-fe15-450f-927b-576f4dadc481 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.253519 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3b49b7f6-fe15-450f-927b-576f4dadc481 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.253957 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3b49b7f6-fe15-450f-927b-576f4dadc481 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.278838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3b49b7f6-fe15-450f-927b-576f4dadc481 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:11:40.411931 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:40.455433 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ad15ed93-1629-48c1-a977-ab8a131421c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:40.456064 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ad15ed93-1629-48c1-a977-ab8a131421c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:40.462053 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad15ed93-1629-48c1-a977-ab8a131421c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.462537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad15ed93-1629-48c1-a977-ab8a131421c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.463250 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad15ed93-1629-48c1-a977-ab8a131421c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.463682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad15ed93-1629-48c1-a977-ab8a131421c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.499748 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:40.594433 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ad15ed93-1629-48c1-a977-ab8a131421c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:40.602102 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ad15ed93-1629-48c1-a977-ab8a131421c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.151273 Jun 23 20:11:40.602664 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 296/578] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:40 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:40.612853 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3b49b7f6-fe15-450f-927b-576f4dadc481 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 204 len: 0 microversion: 2.1 time: 0.371102 Jun 23 20:11:40.613439 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 283/579] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:11:40 2022] DELETE /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:11:40.621113 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f1dff3fc-0793-4c0f-8712-2e482549a761 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:40.621741 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f1dff3fc-0793-4c0f-8712-2e482549a761 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:40.628214 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f1dff3fc-0793-4c0f-8712-2e482549a761 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.628692 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f1dff3fc-0793-4c0f-8712-2e482549a761 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.629438 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f1dff3fc-0793-4c0f-8712-2e482549a761 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.629865 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f1dff3fc-0793-4c0f-8712-2e482549a761 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.756679 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f1dff3fc-0793-4c0f-8712-2e482549a761 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:40.763987 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f1dff3fc-0793-4c0f-8712-2e482549a761 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1687 microversion: 2.1 time: 0.146638 Jun 23 20:11:40.765205 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 297/580] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:40 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1687 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:40.799238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:40.799928 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:40.806401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.806844 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.807598 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:40.808028 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:40.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:40.942497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:40.943988 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:40.945117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8034fc4c-aaab-421a-af9b-cd84f8040d5b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1407 microversion: 2.20 time: 0.150580 Jun 23 20:11:40.945680 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 284/581] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:40 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:41.618816 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1cfbcd65-1149-499c-ba38-df3c275d46ed tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:41.619473 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1cfbcd65-1149-499c-ba38-df3c275d46ed tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:41.625596 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1cfbcd65-1149-499c-ba38-df3c275d46ed tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:41.626043 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1cfbcd65-1149-499c-ba38-df3c275d46ed tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:41.626797 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1cfbcd65-1149-499c-ba38-df3c275d46ed tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:41.627230 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1cfbcd65-1149-499c-ba38-df3c275d46ed tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:41.755234 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1cfbcd65-1149-499c-ba38-df3c275d46ed tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:41.762648 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1cfbcd65-1149-499c-ba38-df3c275d46ed tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.147690 Jun 23 20:11:41.763147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 298/582] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:41 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:41.781044 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9fdb4acf-2669-4cb6-9bb4-7c4971097e9f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:41.781641 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9fdb4acf-2669-4cb6-9bb4-7c4971097e9f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:41.788029 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9fdb4acf-2669-4cb6-9bb4-7c4971097e9f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:41.788513 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9fdb4acf-2669-4cb6-9bb4-7c4971097e9f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:41.789261 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9fdb4acf-2669-4cb6-9bb4-7c4971097e9f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:41.789690 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9fdb4acf-2669-4cb6-9bb4-7c4971097e9f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:41.913196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9fdb4acf-2669-4cb6-9bb4-7c4971097e9f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:41.920463 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9fdb4acf-2669-4cb6-9bb4-7c4971097e9f tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1687 microversion: 2.1 time: 0.143694 Jun 23 20:11:41.921047 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 285/583] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:41 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1687 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:41.962867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:41.963490 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:41.970091 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:41.970536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:41.971289 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:41.971723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:42.112623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:42.120638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:42.122142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:42.123243 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-95f97cc0-b60c-4779-8a3f-e6f610692111 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1407 microversion: 2.20 time: 0.164298 Jun 23 20:11:42.124568 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 299/584] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:41 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:42.778843 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-57f0593f-5d48-4ca4-b68b-4b32ae25e904 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:42.779488 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-57f0593f-5d48-4ca4-b68b-4b32ae25e904 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:42.786768 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-57f0593f-5d48-4ca4-b68b-4b32ae25e904 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:42.788408 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-57f0593f-5d48-4ca4-b68b-4b32ae25e904 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:42.789190 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-57f0593f-5d48-4ca4-b68b-4b32ae25e904 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:42.789633 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-57f0593f-5d48-4ca4-b68b-4b32ae25e904 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:42.919445 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-57f0593f-5d48-4ca4-b68b-4b32ae25e904 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:42.927927 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-57f0593f-5d48-4ca4-b68b-4b32ae25e904 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.152875 Jun 23 20:11:42.932605 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 286/585] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:42 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:42.937218 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ab7e5ae7-a93e-4d3f-b615-8fbdd79228d7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:42.937826 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ab7e5ae7-a93e-4d3f-b615-8fbdd79228d7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:42.943887 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab7e5ae7-a93e-4d3f-b615-8fbdd79228d7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:42.944374 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab7e5ae7-a93e-4d3f-b615-8fbdd79228d7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:42.945362 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab7e5ae7-a93e-4d3f-b615-8fbdd79228d7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:42.945805 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ab7e5ae7-a93e-4d3f-b615-8fbdd79228d7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:43.072890 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-ab7e5ae7-a93e-4d3f-b615-8fbdd79228d7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:43.080675 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ab7e5ae7-a93e-4d3f-b615-8fbdd79228d7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1687 microversion: 2.1 time: 0.147251 Jun 23 20:11:43.081239 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 300/586] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:42 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1687 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:43.141739 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:43.142364 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:43.148282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:43.148760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:43.149515 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:43.149954 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:43.256848 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:43.278133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:43.280871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=16 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:43.287233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:43.288769 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:43.289858 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f7495467-5208-4ca7-ad41-821a211adc8d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1407 microversion: 2.20 time: 0.152450 Jun 23 20:11:43.290416 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 287/587] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:43 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:43.946265 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2d2c79f8-7c64-4196-be8a-3093a4607e7c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:43.946792 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2d2c79f8-7c64-4196-be8a-3093a4607e7c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:43.948851 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=4 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:43.956713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2d2c79f8-7c64-4196-be8a-3093a4607e7c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:43.957457 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2d2c79f8-7c64-4196-be8a-3093a4607e7c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:43.958727 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2d2c79f8-7c64-4196-be8a-3093a4607e7c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:43.959401 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2d2c79f8-7c64-4196-be8a-3093a4607e7c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:44.097941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a55a63b8-748d-4bec-9f27-22cd052fb0f8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:44.098538 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a55a63b8-748d-4bec-9f27-22cd052fb0f8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:44.101353 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2d2c79f8-7c64-4196-be8a-3093a4607e7c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:44.106026 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a55a63b8-748d-4bec-9f27-22cd052fb0f8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:44.106475 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a55a63b8-748d-4bec-9f27-22cd052fb0f8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:44.107233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a55a63b8-748d-4bec-9f27-22cd052fb0f8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:44.107659 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a55a63b8-748d-4bec-9f27-22cd052fb0f8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:44.109348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2d2c79f8-7c64-4196-be8a-3093a4607e7c tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.169092 Jun 23 20:11:44.109915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 301/588] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:43 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:44.241514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a55a63b8-748d-4bec-9f27-22cd052fb0f8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:44.244208 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-b8d3857a-54cc-45f8-8e55-1d724f729977 req-104b9215-49ea-485a-b653-77faf9f276e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfc5144-0d0f-4d88-bfef-d92a270ca655", "name": "network-vif-plugged", "status": "completed", "tag": "048e62b5-3005-46cb-96bf-1c13423b57db"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:44.249288 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a55a63b8-748d-4bec-9f27-22cd052fb0f8 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1687 microversion: 2.1 time: 0.155609 Jun 23 20:11:44.250123 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 288/589] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:44 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:44.252446 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-b8d3857a-54cc-45f8-8e55-1d724f729977 req-104b9215-49ea-485a-b653-77faf9f276e3 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:44.252885 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-b8d3857a-54cc-45f8-8e55-1d724f729977 req-104b9215-49ea-485a-b653-77faf9f276e3 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:44.263874 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-b8d3857a-54cc-45f8-8e55-1d724f729977 req-104b9215-49ea-485a-b653-77faf9f276e3 service nova] Creating event network-vif-plugged:048e62b5-3005-46cb-96bf-1c13423b57db for instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 on hv-cinder-84727 Jun 23 20:11:44.268754 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-b8d3857a-54cc-45f8-8e55-1d724f729977 req-104b9215-49ea-485a-b653-77faf9f276e3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028094 Jun 23 20:11:44.269334 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 302/590] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:11:44.307042 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:44.307646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:44.313774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:44.314225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:44.314977 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:44.315413 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:44.446321 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:44.454550 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:44.456082 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:44.457214 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-03c97929-7702-43a2-a885-b5f13d529cc0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1407 microversion: 2.20 time: 0.154072 Jun 23 20:11:44.457774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 289/591] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:44 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:45.127050 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a18dfd27-bceb-4521-8726-f414296642de tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:45.127740 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a18dfd27-bceb-4521-8726-f414296642de tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:45.134210 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a18dfd27-bceb-4521-8726-f414296642de tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:45.134653 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a18dfd27-bceb-4521-8726-f414296642de tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:45.135400 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a18dfd27-bceb-4521-8726-f414296642de tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:45.135826 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a18dfd27-bceb-4521-8726-f414296642de tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:45.266365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-508bcbfa-620a-4fb3-9699-42be002c1e6d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:45.266974 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-508bcbfa-620a-4fb3-9699-42be002c1e6d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:45.273752 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-508bcbfa-620a-4fb3-9699-42be002c1e6d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:45.274202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-508bcbfa-620a-4fb3-9699-42be002c1e6d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:45.274962 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-508bcbfa-620a-4fb3-9699-42be002c1e6d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:45.275394 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-508bcbfa-620a-4fb3-9699-42be002c1e6d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:45.396265 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a18dfd27-bceb-4521-8726-f414296642de tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:45.403922 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a18dfd27-bceb-4521-8726-f414296642de tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.281616 Jun 23 20:11:45.404730 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 303/592] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:45 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:45.475663 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:45.475815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-508bcbfa-620a-4fb3-9699-42be002c1e6d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:45.476850 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:45.483634 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:45.483815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-508bcbfa-620a-4fb3-9699-42be002c1e6d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1687 microversion: 2.1 time: 0.221311 Jun 23 20:11:45.484099 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:45.488353 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 290/593] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:45 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1687 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:45.488528 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:45.488528 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:45.963619 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:45.971959 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:45.973766 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:45.975056 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b9e7bc89-6aa4-4af7-bcb9-e63ec8e776ea tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1407 microversion: 2.20 time: 0.503871 Jun 23 20:11:45.975982 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 304/594] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:45 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:46.151414 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-db1a691b-f247-4dc6-a351-2dc8bfa5f628 req-92a79e06-3715-48ae-bed0-9956042c1c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5de1ee-6219-48dc-af73-d21b440c9122", "name": "network-vif-deleted", "tag": "27c60352-48b3-4e75-b043-6c1f57dcdca4"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:46.159561 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-db1a691b-f247-4dc6-a351-2dc8bfa5f628 req-92a79e06-3715-48ae-bed0-9956042c1c5b service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:46.160010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-db1a691b-f247-4dc6-a351-2dc8bfa5f628 req-92a79e06-3715-48ae-bed0-9956042c1c5b service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:46.172241 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-db1a691b-f247-4dc6-a351-2dc8bfa5f628 req-92a79e06-3715-48ae-bed0-9956042c1c5b service nova] Creating event network-vif-deleted:27c60352-48b3-4e75-b043-6c1f57dcdca4 for instance 6e5de1ee-6219-48dc-af73-d21b440c9122 on hv-cinder-84727 Jun 23 20:11:46.176788 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-db1a691b-f247-4dc6-a351-2dc8bfa5f628 req-92a79e06-3715-48ae-bed0-9956042c1c5b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028918 Jun 23 20:11:46.177340 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 291/595] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:11:46.421121 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-98fd8b17-1d19-4fbe-b434-34a8a306ec0d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:46.421803 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-98fd8b17-1d19-4fbe-b434-34a8a306ec0d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:46.427891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-98fd8b17-1d19-4fbe-b434-34a8a306ec0d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:46.428564 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-98fd8b17-1d19-4fbe-b434-34a8a306ec0d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:46.429750 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-98fd8b17-1d19-4fbe-b434-34a8a306ec0d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:46.430215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-98fd8b17-1d19-4fbe-b434-34a8a306ec0d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:46.500577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d46b81c0-f058-4505-a166-b7cbfaf6e3ed tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:46.501951 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d46b81c0-f058-4505-a166-b7cbfaf6e3ed tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:46.568911 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d46b81c0-f058-4505-a166-b7cbfaf6e3ed tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:46.569435 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d46b81c0-f058-4505-a166-b7cbfaf6e3ed tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:46.569678 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-98fd8b17-1d19-4fbe-b434-34a8a306ec0d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:46.570376 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d46b81c0-f058-4505-a166-b7cbfaf6e3ed tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:46.570819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d46b81c0-f058-4505-a166-b7cbfaf6e3ed tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:46.577267 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-98fd8b17-1d19-4fbe-b434-34a8a306ec0d tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.160583 Jun 23 20:11:46.578814 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 305/596] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:46 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:46.638843 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d46b81c0-f058-4505-a166-b7cbfaf6e3ed tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:46.646558 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d46b81c0-f058-4505-a166-b7cbfaf6e3ed tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1329 microversion: 2.1 time: 0.150459 Jun 23 20:11:46.647137 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 292/597] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:46 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1329 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:46.993802 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:46.994520 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:47.000873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:47.001313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:47.002070 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:47.002498 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:47.140619 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:47.148645 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:47.150137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:47.151451 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a3308f0c-a4dc-48c9-a32a-81918532c78f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1407 microversion: 2.20 time: 0.161753 Jun 23 20:11:47.151812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 306/598] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:46 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:47.594760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-187c0850-5968-458d-98ac-03946a251ce2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:47.595380 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-187c0850-5968-458d-98ac-03946a251ce2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:47.601883 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-187c0850-5968-458d-98ac-03946a251ce2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:47.602359 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-187c0850-5968-458d-98ac-03946a251ce2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:47.603210 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-187c0850-5968-458d-98ac-03946a251ce2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:47.603637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-187c0850-5968-458d-98ac-03946a251ce2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:47.662907 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:47.663680 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:47.669828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:47.674883 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:47.674883 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:47.674883 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:47.704523 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:47.704976 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:47.705431 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lazy-loading 'fault' on Instance uuid 6e5de1ee-6219-48dc-af73-d21b440c9122 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:11:47.762863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:47.768181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-187c0850-5968-458d-98ac-03946a251ce2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:47.771032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8043cc7a-1f42-4eac-94f4-c9f4e8326a5d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 200 len: 1334 microversion: 2.1 time: 0.111973 Jun 23 20:11:47.772016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 307/599] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:47 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:47.779354 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-187c0850-5968-458d-98ac-03946a251ce2 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.188489 Jun 23 20:11:47.779984 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 293/600] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:47 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:48.169518 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:48.170208 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:48.176793 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:48.177234 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:48.177977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:48.178402 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:48.307052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:48.310676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=100 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:48.315471 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:48.317054 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:48.318194 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5617fcdc-2aa4-44da-a1e7-6816fd812bed tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1599 microversion: 2.20 time: 0.152596 Jun 23 20:11:48.318750 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 308/601] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:11:48 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:11:48.339541 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-91908dd2-c277-4618-b70a-94cc4197a40d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:48.339983 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-91908dd2-c277-4618-b70a-94cc4197a40d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:48.346442 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91908dd2-c277-4618-b70a-94cc4197a40d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:48.346882 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91908dd2-c277-4618-b70a-94cc4197a40d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:48.347637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91908dd2-c277-4618-b70a-94cc4197a40d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:48.348065 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-91908dd2-c277-4618-b70a-94cc4197a40d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:48.423733 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-91908dd2-c277-4618-b70a-94cc4197a40d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088014 Jun 23 20:11:48.424357 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 294/602] 10.222.0.44 () {60 vars in 1315 bytes} [Thu Jun 23 20:11:48 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:11:48.788212 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:48.790481 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 6e5de1ee-6219-48dc-af73-d21b440c9122] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:48.796855 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9300f01f-9601-4071-b254-75d0ca049b54 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:48.797612 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9300f01f-9601-4071-b254-75d0ca049b54 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:48.799669 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:48.800532 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:48.801469 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:48.802204 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:48.807483 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9300f01f-9601-4071-b254-75d0ca049b54 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:48.813637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9300f01f-9601-4071-b254-75d0ca049b54 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:48.813637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9300f01f-9601-4071-b254-75d0ca049b54 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:48.813637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9300f01f-9601-4071-b254-75d0ca049b54 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:48.822856 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] HTTP exception thrown: Instance 6e5de1ee-6219-48dc-af73-d21b440c9122 could not be found. Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Request method failure captured: Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 HTTP/1.1 Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfyxzsamWYAY4W_HtOHWWevrTKWC8RK4VJTVqs_TfC8PoEejL0VGty_DaRq72Ond_ur5yKbVnIGJB1lU8bRv9C_AbQd_Bs0vATjE74j-5caMuhy7j0rXIoUAsJTnACzMgvQ_haumEiGr9liO6idCPQubzNFUJivCbjspeWNnvni-HA Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:11:48.824905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf37c9d0240b48078038d70f678a93eb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf37c9d0240b48078038d70f678a93eb"}]}] Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: f041449191c94a5ca5a38c29dd146a15 Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 6e5de1ee-6219-48dc-af73-d21b440c9122 could not be found. Jun 23 20:11:48.828141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '6e5de1ee-6219-48dc-af73-d21b440c9122'} Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e5de1ee-6219-48dc-af73-d21b440c9122 could not be found. Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:11:48.829165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e5de1ee-6219-48dc-af73-d21b440c9122 could not be found. Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e5de1ee-6219-48dc-af73-d21b440c9122 could not be found. Jun 23 20:11:48.831286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:48.833736 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Returning 404 to user: Instance 6e5de1ee-6219-48dc-af73-d21b440c9122 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:11:48.835356 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-38fc5ae5-667f-4b15-83d1-27397d158bf7 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122" status: 404 len: 111 microversion: 2.1 time: 0.051251 Jun 23 20:11:48.836441 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 309/603] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:48 2022] GET /compute/v2.1/servers/6e5de1ee-6219-48dc-af73-d21b440c9122 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:11:48.844904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-027e59aa-232c-4ba0-a605-28dea552bb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '.version_select at 0x7f90d9f350d0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:48.941582 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-027e59aa-232c-4ba0-a605-28dea552bb09 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042797951" status: 202 len: 0 microversion: 2.1 time: 0.100847 Jun 23 20:11:48.942171 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 310/604] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jun 23 20:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042797951 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 20:11:49.002473 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9300f01f-9601-4071-b254-75d0ca049b54 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:49.010236 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9300f01f-9601-4071-b254-75d0ca049b54 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.218466 Jun 23 20:11:49.011035 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 295/605] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:48 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:49.472754 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-8f431b74-065b-45c6-838e-855d4d7c07b6 req-146dbee0-cdcb-4dd2-9831-5e993b36831a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfc5144-0d0f-4d88-bfef-d92a270ca655", "tag": "048e62b5-3005-46cb-96bf-1c13423b57db"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:49.480560 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-8f431b74-065b-45c6-838e-855d4d7c07b6 req-146dbee0-cdcb-4dd2-9831-5e993b36831a service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:49.481223 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-8f431b74-065b-45c6-838e-855d4d7c07b6 req-146dbee0-cdcb-4dd2-9831-5e993b36831a service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:49.493330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-8f431b74-065b-45c6-838e-855d4d7c07b6 req-146dbee0-cdcb-4dd2-9831-5e993b36831a service nova] Creating event network-changed:048e62b5-3005-46cb-96bf-1c13423b57db for instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 on hv-cinder-84727 Jun 23 20:11:49.498979 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-8f431b74-065b-45c6-838e-855d4d7c07b6 req-146dbee0-cdcb-4dd2-9831-5e993b36831a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030128 Jun 23 20:11:49.499753 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 311/606] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:49.767460 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b8f12615-c341-4090-9dcc-56f0acccb29d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:49.768066 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b8f12615-c341-4090-9dcc-56f0acccb29d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:49.774266 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b8f12615-c341-4090-9dcc-56f0acccb29d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:49.774704 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b8f12615-c341-4090-9dcc-56f0acccb29d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:49.775807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b8f12615-c341-4090-9dcc-56f0acccb29d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:49.776443 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b8f12615-c341-4090-9dcc-56f0acccb29d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:49.804177 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b8f12615-c341-4090-9dcc-56f0acccb29d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/ips" status: 200 len: 148 microversion: 2.1 time: 0.040692 Jun 23 20:11:49.810071 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 296/607] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:11:49 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:50.027908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e4d54add-8288-4bfb-9fef-b30e5071421e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:50.030346 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e4d54add-8288-4bfb-9fef-b30e5071421e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:50.037758 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e4d54add-8288-4bfb-9fef-b30e5071421e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:50.038765 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e4d54add-8288-4bfb-9fef-b30e5071421e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:50.039780 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e4d54add-8288-4bfb-9fef-b30e5071421e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:50.040681 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e4d54add-8288-4bfb-9fef-b30e5071421e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:50.201196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e4d54add-8288-4bfb-9fef-b30e5071421e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:50.209022 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e4d54add-8288-4bfb-9fef-b30e5071421e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.185501 Jun 23 20:11:50.209705 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 312/608] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:50 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:50.304636 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-bf971acf-8cfa-4f4d-b8cf-74aa35ff2759 req-c5192dd9-78be-473e-9226-1deca1b4611c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d760fb45-e1c6-4ac7-9d84-a507fd45b396", "name": "network-vif-plugged", "status": "completed", "tag": "0b827b10-c629-4517-9e99-ed82b161fe9d"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:50.313589 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-bf971acf-8cfa-4f4d-b8cf-74aa35ff2759 req-c5192dd9-78be-473e-9226-1deca1b4611c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:50.314032 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-bf971acf-8cfa-4f4d-b8cf-74aa35ff2759 req-c5192dd9-78be-473e-9226-1deca1b4611c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:50.325612 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-bf971acf-8cfa-4f4d-b8cf-74aa35ff2759 req-c5192dd9-78be-473e-9226-1deca1b4611c service nova] Creating event network-vif-plugged:0b827b10-c629-4517-9e99-ed82b161fe9d for instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 on hv-cinder-84727 Jun 23 20:11:50.331368 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-bf971acf-8cfa-4f4d-b8cf-74aa35ff2759 req-c5192dd9-78be-473e-9226-1deca1b4611c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030510 Jun 23 20:11:50.332152 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 297/609] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:51.225689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0119298e-e769-41fd-9128-4e4fde3c3940 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:51.226295 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0119298e-e769-41fd-9128-4e4fde3c3940 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:51.234489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0119298e-e769-41fd-9128-4e4fde3c3940 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:51.235449 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0119298e-e769-41fd-9128-4e4fde3c3940 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:51.236221 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0119298e-e769-41fd-9128-4e4fde3c3940 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:51.236713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0119298e-e769-41fd-9128-4e4fde3c3940 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:51.368909 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0119298e-e769-41fd-9128-4e4fde3c3940 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:51.376339 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0119298e-e769-41fd-9128-4e4fde3c3940 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.154510 Jun 23 20:11:51.376903 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 313/610] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:51 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:51.528954 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5a13c376-de99-4b01-b607-39048498a3e7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95cfeb90-d5b4-49d4-8868-75df399dece6"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:51.530729 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5a13c376-de99-4b01-b607-39048498a3e7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:51.537692 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a13c376-de99-4b01-b607-39048498a3e7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:51.538144 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a13c376-de99-4b01-b607-39048498a3e7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:51.538882 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a13c376-de99-4b01-b607-39048498a3e7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:51.539312 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a13c376-de99-4b01-b607-39048498a3e7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:52.290541 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6a3f60fc-c97f-4100-8dd4-b89dcb907ba5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:52.291020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6a3f60fc-c97f-4100-8dd4-b89dcb907ba5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:52.297067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6a3f60fc-c97f-4100-8dd4-b89dcb907ba5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:52.297514 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6a3f60fc-c97f-4100-8dd4-b89dcb907ba5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:52.298268 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6a3f60fc-c97f-4100-8dd4-b89dcb907ba5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:52.298699 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6a3f60fc-c97f-4100-8dd4-b89dcb907ba5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:52.302835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5a13c376-de99-4b01-b607-39048498a3e7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777932 Jun 23 20:11:52.303474 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 298/611] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:11:51 2022] POST /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:52.324391 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6a3f60fc-c97f-4100-8dd4-b89dcb907ba5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:11:52.394035 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-747ed88f-f213-45e8-bfbc-e14c8fe80602 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:52.394647 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-747ed88f-f213-45e8-bfbc-e14c8fe80602 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:52.400868 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-747ed88f-f213-45e8-bfbc-e14c8fe80602 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:52.401310 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-747ed88f-f213-45e8-bfbc-e14c8fe80602 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:52.402054 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-747ed88f-f213-45e8-bfbc-e14c8fe80602 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:52.402485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-747ed88f-f213-45e8-bfbc-e14c8fe80602 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:52.543459 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-747ed88f-f213-45e8-bfbc-e14c8fe80602 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:52.557232 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-747ed88f-f213-45e8-bfbc-e14c8fe80602 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1265 microversion: 2.1 time: 0.167812 Jun 23 20:11:52.558098 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 299/612] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:52 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:52.664730 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6a3f60fc-c97f-4100-8dd4-b89dcb907ba5 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "DELETE /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 204 len: 0 microversion: 2.1 time: 0.377758 Jun 23 20:11:52.665402 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 314/613] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:11:52 2022] DELETE /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 20:11:52.675755 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8be8b627-0a28-4a98-bb41-ef4ae568587d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:52.679372 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8be8b627-0a28-4a98-bb41-ef4ae568587d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:52.683153 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8be8b627-0a28-4a98-bb41-ef4ae568587d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:52.683607 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8be8b627-0a28-4a98-bb41-ef4ae568587d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:52.684433 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8be8b627-0a28-4a98-bb41-ef4ae568587d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:52.684873 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8be8b627-0a28-4a98-bb41-ef4ae568587d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:52.820175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8be8b627-0a28-4a98-bb41-ef4ae568587d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:52.828488 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8be8b627-0a28-4a98-bb41-ef4ae568587d tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1508 microversion: 2.1 time: 0.158519 Jun 23 20:11:52.829045 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 300/614] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:52 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:53.575127 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-77df8871-9ead-473c-833c-f8c68c995216 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:53.575828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-77df8871-9ead-473c-833c-f8c68c995216 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:53.582181 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77df8871-9ead-473c-833c-f8c68c995216 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:53.582628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77df8871-9ead-473c-833c-f8c68c995216 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:53.583382 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77df8871-9ead-473c-833c-f8c68c995216 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:53.583816 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-77df8871-9ead-473c-833c-f8c68c995216 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:53.712907 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-77df8871-9ead-473c-833c-f8c68c995216 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:53.720983 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-77df8871-9ead-473c-833c-f8c68c995216 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1452 microversion: 2.1 time: 0.150104 Jun 23 20:11:53.721551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 315/615] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:53 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:53.736670 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-196c3b30-f56d-45f6-8ab2-78fc7ae0862b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:53.737276 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-196c3b30-f56d-45f6-8ab2-78fc7ae0862b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:53.743201 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-196c3b30-f56d-45f6-8ab2-78fc7ae0862b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:53.743655 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-196c3b30-f56d-45f6-8ab2-78fc7ae0862b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:53.744447 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-196c3b30-f56d-45f6-8ab2-78fc7ae0862b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:53.744884 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-196c3b30-f56d-45f6-8ab2-78fc7ae0862b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:53.749027 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:11:53.846187 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-75439004-3d5b-44f2-94e6-0c3ebff23708 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:53.846885 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-75439004-3d5b-44f2-94e6-0c3ebff23708 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:53.853494 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75439004-3d5b-44f2-94e6-0c3ebff23708 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:53.854128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75439004-3d5b-44f2-94e6-0c3ebff23708 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:53.854732 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75439004-3d5b-44f2-94e6-0c3ebff23708 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:53.855160 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75439004-3d5b-44f2-94e6-0c3ebff23708 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:53.872164 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-196c3b30-f56d-45f6-8ab2-78fc7ae0862b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:53.880025 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-196c3b30-f56d-45f6-8ab2-78fc7ae0862b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1452 microversion: 2.1 time: 0.147115 Jun 23 20:11:53.880622 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 301/616] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:53 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:54.000920 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-75439004-3d5b-44f2-94e6-0c3ebff23708 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:54.008650 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-75439004-3d5b-44f2-94e6-0c3ebff23708 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1508 microversion: 2.1 time: 0.166973 Jun 23 20:11:54.009204 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 316/617] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:53 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:11:55.025663 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d66bb8ba-ef38-4db7-9c01-e369b2a3ecac tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:55.026375 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d66bb8ba-ef38-4db7-9c01-e369b2a3ecac tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:55.033854 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d66bb8ba-ef38-4db7-9c01-e369b2a3ecac tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:55.034398 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d66bb8ba-ef38-4db7-9c01-e369b2a3ecac tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:55.035169 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d66bb8ba-ef38-4db7-9c01-e369b2a3ecac tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:55.035604 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d66bb8ba-ef38-4db7-9c01-e369b2a3ecac tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:55.268275 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d66bb8ba-ef38-4db7-9c01-e369b2a3ecac tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:55.275952 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d66bb8ba-ef38-4db7-9c01-e369b2a3ecac tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1508 microversion: 2.1 time: 0.254206 Jun 23 20:11:55.276562 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 302/618] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:55 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:55.995451 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-43642f85-65ed-4e8d-9296-b09d6f4a62de req-34eb39da-638b-4cae-98d6-caa675e1b8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987900b9-9acf-4c20-a35e-edafdeb4454f", "name": "network-vif-deleted", "tag": "0b459b45-118e-4c32-8dbf-c6257947db62"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:56.006211 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-43642f85-65ed-4e8d-9296-b09d6f4a62de req-34eb39da-638b-4cae-98d6-caa675e1b8e8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:56.011420 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-43642f85-65ed-4e8d-9296-b09d6f4a62de req-34eb39da-638b-4cae-98d6-caa675e1b8e8 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:56.019179 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-43642f85-65ed-4e8d-9296-b09d6f4a62de req-34eb39da-638b-4cae-98d6-caa675e1b8e8 service nova] Creating event network-vif-deleted:0b459b45-118e-4c32-8dbf-c6257947db62 for instance 987900b9-9acf-4c20-a35e-edafdeb4454f on hv-cinder-84727 Jun 23 20:11:56.023963 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-43642f85-65ed-4e8d-9296-b09d6f4a62de req-34eb39da-638b-4cae-98d6-caa675e1b8e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032657 Jun 23 20:11:56.024585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 317/619] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:11:56.299553 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:56.300167 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:56.315114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:56.315561 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:56.316363 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:56.316860 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:56.358411 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:56.359468 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:56.359907 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lazy-loading 'fault' on Instance uuid 987900b9-9acf-4c20-a35e-edafdeb4454f {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:11:56.438881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:56.446983 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f6122ffb-a635-4266-8d36-45c89482e2a6 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 200 len: 1312 microversion: 2.1 time: 0.157403 Jun 23 20:11:56.447894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 303/620] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:56 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:57.467015 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:57.467654 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: 987900b9-9acf-4c20-a35e-edafdeb4454f] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:57.474466 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:57.474911 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:57.475670 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:57.476096 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:57.489368 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] HTTP exception thrown: Instance 987900b9-9acf-4c20-a35e-edafdeb4454f could not be found. Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Request method failure captured: Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f HTTP/1.1 Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfyxzsamWYAY4W_HtOHWWevrTKWC8RK4VJTVqs_TfC8PoEejL0VGty_DaRq72Ond_ur5yKbVnIGJB1lU8bRv9C_AbQd_Bs0vATjE74j-5caMuhy7j0rXIoUAsJTnACzMgvQ_haumEiGr9liO6idCPQubzNFUJivCbjspeWNnvni-HA Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:11:57.491020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf37c9d0240b48078038d70f678a93eb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf37c9d0240b48078038d70f678a93eb"}]}] Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: f041449191c94a5ca5a38c29dd146a15 Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 987900b9-9acf-4c20-a35e-edafdeb4454f could not be found. Jun 23 20:11:57.492571 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '987900b9-9acf-4c20-a35e-edafdeb4454f'} Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987900b9-9acf-4c20-a35e-edafdeb4454f could not be found. Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:11:57.493398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987900b9-9acf-4c20-a35e-edafdeb4454f could not be found. Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987900b9-9acf-4c20-a35e-edafdeb4454f could not be found. Jun 23 20:11:57.494842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:11:57.495912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Returning 404 to user: Instance 987900b9-9acf-4c20-a35e-edafdeb4454f could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:11:57.495912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bd2f3230-0f2c-4074-894d-c2eadcb85636 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f" status: 404 len: 111 microversion: 2.1 time: 0.029834 Jun 23 20:11:57.495912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 318/621] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:57 2022] GET /compute/v2.1/servers/987900b9-9acf-4c20-a35e-edafdeb4454f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:11:57.501478 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-73b4d01c-77b4-4f4f-9fe9-503a14e83eaf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:57.503009 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-73b4d01c-77b4-4f4f-9fe9-503a14e83eaf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:57.509473 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73b4d01c-77b4-4f4f-9fe9-503a14e83eaf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:57.514133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73b4d01c-77b4-4f4f-9fe9-503a14e83eaf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:57.514133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73b4d01c-77b4-4f4f-9fe9-503a14e83eaf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:57.514133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-73b4d01c-77b4-4f4f-9fe9-503a14e83eaf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:57.538105 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-73b4d01c-77b4-4f4f-9fe9-503a14e83eaf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:11:57.831046 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-73b4d01c-77b4-4f4f-9fe9-503a14e83eaf tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 204 len: 0 microversion: 2.1 time: 0.333171 Jun 23 20:11:57.831659 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 304/622] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:11:57 2022] DELETE /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:11:57.839769 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b3e77b85-ae42-4e08-a719-bed5a7215d6c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:57.840435 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b3e77b85-ae42-4e08-a719-bed5a7215d6c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:57.847717 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b3e77b85-ae42-4e08-a719-bed5a7215d6c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:57.848155 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b3e77b85-ae42-4e08-a719-bed5a7215d6c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:57.848919 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b3e77b85-ae42-4e08-a719-bed5a7215d6c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:57.849345 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b3e77b85-ae42-4e08-a719-bed5a7215d6c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:57.976587 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b3e77b85-ae42-4e08-a719-bed5a7215d6c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:57.982916 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b3e77b85-ae42-4e08-a719-bed5a7215d6c tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.147114 Jun 23 20:11:57.983470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 319/623] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:57 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:11:58.054858 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-570ba246-8619-4fb2-8d84-c29372819fc2 req-0ba28ea8-8beb-468c-be1e-cbff21e2253e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d760fb45-e1c6-4ac7-9d84-a507fd45b396", "tag": "0b827b10-c629-4517-9e99-ed82b161fe9d"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:11:58.067553 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-570ba246-8619-4fb2-8d84-c29372819fc2 req-0ba28ea8-8beb-468c-be1e-cbff21e2253e service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:58.068000 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-570ba246-8619-4fb2-8d84-c29372819fc2 req-0ba28ea8-8beb-468c-be1e-cbff21e2253e service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:58.079734 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-570ba246-8619-4fb2-8d84-c29372819fc2 req-0ba28ea8-8beb-468c-be1e-cbff21e2253e service nova] Creating event network-changed:0b827b10-c629-4517-9e99-ed82b161fe9d for instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 on hv-cinder-84727 Jun 23 20:11:58.084658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-570ba246-8619-4fb2-8d84-c29372819fc2 req-0ba28ea8-8beb-468c-be1e-cbff21e2253e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034607 Jun 23 20:11:58.085174 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 305/624] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:11:58.999831 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fa74908c-9541-4307-a89e-4231b0fbb69a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:11:59.000389 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fa74908c-9541-4307-a89e-4231b0fbb69a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:11:59.006436 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fa74908c-9541-4307-a89e-4231b0fbb69a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:59.006880 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fa74908c-9541-4307-a89e-4231b0fbb69a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:59.007624 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fa74908c-9541-4307-a89e-4231b0fbb69a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:11:59.008061 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fa74908c-9541-4307-a89e-4231b0fbb69a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:11:59.135407 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fa74908c-9541-4307-a89e-4231b0fbb69a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:11:59.143196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fa74908c-9541-4307-a89e-4231b0fbb69a tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.147351 Jun 23 20:11:59.143752 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 320/625] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:11:58 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:00.161419 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bbaa4744-6df7-4a7b-99c7-cc29353fd5c0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:00.162114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bbaa4744-6df7-4a7b-99c7-cc29353fd5c0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:00.168376 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bbaa4744-6df7-4a7b-99c7-cc29353fd5c0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:00.168829 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bbaa4744-6df7-4a7b-99c7-cc29353fd5c0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:00.169587 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bbaa4744-6df7-4a7b-99c7-cc29353fd5c0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:00.170030 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bbaa4744-6df7-4a7b-99c7-cc29353fd5c0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:00.297636 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bbaa4744-6df7-4a7b-99c7-cc29353fd5c0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:00.305097 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bbaa4744-6df7-4a7b-99c7-cc29353fd5c0 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.148500 Jun 23 20:12:00.305661 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 306/626] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:00 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:01.322302 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-79f533d4-569b-4a76-9c15-5edaa91408fb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:01.322932 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-79f533d4-569b-4a76-9c15-5edaa91408fb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:01.324920 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:01.330411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-79f533d4-569b-4a76-9c15-5edaa91408fb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:01.333041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-79f533d4-569b-4a76-9c15-5edaa91408fb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:01.333041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-79f533d4-569b-4a76-9c15-5edaa91408fb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:01.333041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-79f533d4-569b-4a76-9c15-5edaa91408fb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:01.563953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-79f533d4-569b-4a76-9c15-5edaa91408fb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:01.571691 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-79f533d4-569b-4a76-9c15-5edaa91408fb tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1521 microversion: 2.1 time: 0.253217 Jun 23 20:12:01.572252 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 321/627] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:01 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:02.588802 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cfc4faf6-9333-4608-92cf-58d1323c13f4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:02.589410 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cfc4faf6-9333-4608-92cf-58d1323c13f4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:02.600418 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfc4faf6-9333-4608-92cf-58d1323c13f4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:02.601198 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfc4faf6-9333-4608-92cf-58d1323c13f4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:02.601982 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfc4faf6-9333-4608-92cf-58d1323c13f4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:02.602571 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cfc4faf6-9333-4608-92cf-58d1323c13f4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:02.850271 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cfc4faf6-9333-4608-92cf-58d1323c13f4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:02.857451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cfc4faf6-9333-4608-92cf-58d1323c13f4 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1479 microversion: 2.1 time: 0.272513 Jun 23 20:12:02.864430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 307/628] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:02 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1479 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:02.896514 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-7afe583b-c506-47d6-863b-e9bb113d437f req-4cfd12d7-e89d-40e9-820d-561dbf9a69d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade71e5a-f39d-4c61-8364-fd629f524922", "name": "network-vif-deleted", "tag": "8086e419-b878-452b-9a11-4f1f68390daf"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:02.908655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-7afe583b-c506-47d6-863b-e9bb113d437f req-4cfd12d7-e89d-40e9-820d-561dbf9a69d4 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:02.908655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-7afe583b-c506-47d6-863b-e9bb113d437f req-4cfd12d7-e89d-40e9-820d-561dbf9a69d4 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:02.917591 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-7afe583b-c506-47d6-863b-e9bb113d437f req-4cfd12d7-e89d-40e9-820d-561dbf9a69d4 service nova] Creating event network-vif-deleted:8086e419-b878-452b-9a11-4f1f68390daf for instance ade71e5a-f39d-4c61-8364-fd629f524922 on hv-cinder-84727 Jun 23 20:12:02.922506 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-7afe583b-c506-47d6-863b-e9bb113d437f req-4cfd12d7-e89d-40e9-820d-561dbf9a69d4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029547 Jun 23 20:12:02.923396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 322/629] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:02.978444 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95cfeb90-d5b4-49d4-8868-75df399dece6"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:02.979559 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:02.985520 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:02.985966 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:02.987096 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:02.987222 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:03.090303 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Invalid volume: volume 95cfeb90-d5b4-49d4-8868-75df399dece6 is already attached to instances: a0dadba6-4a1e-4c0d-8342-b999e026e0da Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: POST /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments HTTP/1.1 Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 74 Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:12:03.091941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {"volumeAttachment": {"volumeId": "95cfeb90-d5b4-49d4-8868-75df399dece6"}} Jun 23 20:12:03.096199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Invalid volume: volume 95cfeb90-d5b4-49d4-8868-75df399dece6 is already attached to instances: a0dadba6-4a1e-4c0d-8342-b999e026e0da Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'server_id': 'a0dadba6-4a1e-4c0d-8342-b999e026e0da', 'body': {'volumeAttachment': {'volumeId': '95cfeb90-d5b4-49d4-8868-75df399dece6'}}} Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 95cfeb90-d5b4-49d4-8868-75df399dece6 is already attached to instances: a0dadba6-4a1e-4c0d-8342-b999e026e0da Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:03.097139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 95cfeb90-d5b4-49d4-8868-75df399dece6 is already attached to instances: a0dadba6-4a1e-4c0d-8342-b999e026e0da Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:12:03.098514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:12:03.099926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:12:03.099926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:12:03.099926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:12:03.099926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 95cfeb90-d5b4-49d4-8868-75df399dece6 is already attached to instances: a0dadba6-4a1e-4c0d-8342-b999e026e0da Jun 23 20:12:03.099926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:03.099926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 400 to user: Invalid volume: volume 95cfeb90-d5b4-49d4-8868-75df399dece6 is already attached to instances: a0dadba6-4a1e-4c0d-8342-b999e026e0da {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:12:03.099926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2da79b0a-6ef8-4758-8732-fe00b88cc934 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119079 Jun 23 20:12:03.108528 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 308/630] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:12:02 2022] POST /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 20:12:03.155946 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-53ab8380-edcc-44ec-ab19-0f089f697084 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:03.156537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-53ab8380-edcc-44ec-ab19-0f089f697084 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:03.162713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-53ab8380-edcc-44ec-ab19-0f089f697084 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:03.164428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-53ab8380-edcc-44ec-ab19-0f089f697084 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:03.164428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-53ab8380-edcc-44ec-ab19-0f089f697084 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:03.164428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-53ab8380-edcc-44ec-ab19-0f089f697084 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:03.252347 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-53ab8380-edcc-44ec-ab19-0f089f697084 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lazy-loading 'services' on Instance uuid a0dadba6-4a1e-4c0d-8342-b999e026e0da {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:12:03.427167 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-53ab8380-edcc-44ec-ab19-0f089f697084 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments/95cfeb90-d5b4-49d4-8868-75df399dece6" status: 202 len: 0 microversion: 2.1 time: 0.275289 Jun 23 20:12:03.427840 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 323/631] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:12:03 2022] DELETE /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments/95cfeb90-d5b4-49d4-8868-75df399dece6 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 20:12:03.436108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6008bde3-3527-4ce3-a734-68ada7cdf868 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:03.437655 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6008bde3-3527-4ce3-a734-68ada7cdf868 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:03.444557 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6008bde3-3527-4ce3-a734-68ada7cdf868 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:03.445002 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6008bde3-3527-4ce3-a734-68ada7cdf868 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:03.445751 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6008bde3-3527-4ce3-a734-68ada7cdf868 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:03.446181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6008bde3-3527-4ce3-a734-68ada7cdf868 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:03.474559 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6008bde3-3527-4ce3-a734-68ada7cdf868 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 Jun 23 20:12:03.475094 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 309/632] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:12:03 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:03.878837 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:03.879530 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:03.885759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:03.886201 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:03.886940 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:03.887365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:03.916559 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:03.917137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:03.917413 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lazy-loading 'fault' on Instance uuid ade71e5a-f39d-4c61-8364-fd629f524922 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:12:03.960494 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f041449191c94a5ca5a38c29dd146a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf37c9d0240b48078038d70f678a93eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:03.967944 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5111752b-f640-4689-aca3-bad76e6313e1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 200 len: 1311 microversion: 2.1 time: 0.093445 Jun 23 20:12:03.969030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 324/633] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:03 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:04.485860 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e12604e9-a09f-4e82-b20f-7ba05978c43d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:04.486768 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e12604e9-a09f-4e82-b20f-7ba05978c43d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:04.493489 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e12604e9-a09f-4e82-b20f-7ba05978c43d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:04.493897 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e12604e9-a09f-4e82-b20f-7ba05978c43d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:04.494650 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e12604e9-a09f-4e82-b20f-7ba05978c43d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:04.495083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e12604e9-a09f-4e82-b20f-7ba05978c43d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:04.524550 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e12604e9-a09f-4e82-b20f-7ba05978c43d tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042622 Jun 23 20:12:04.525094 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 310/634] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:12:04 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:04.985663 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:04.986238 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] [instance: ade71e5a-f39d-4c61-8364-fd629f524922] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:04.992222 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:04.992697 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:04.993443 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:04.993874 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:05.008383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] HTTP exception thrown: Instance ade71e5a-f39d-4c61-8364-fd629f524922 could not be found. Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Request method failure captured: Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 HTTP/1.1 Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfyxzsamWYAY4W_HtOHWWevrTKWC8RK4VJTVqs_TfC8PoEejL0VGty_DaRq72Ond_ur5yKbVnIGJB1lU8bRv9C_AbQd_Bs0vATjE74j-5caMuhy7j0rXIoUAsJTnACzMgvQ_haumEiGr9liO6idCPQubzNFUJivCbjspeWNnvni-HA Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:12:05.010001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf37c9d0240b48078038d70f678a93eb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf37c9d0240b48078038d70f678a93eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf37c9d0240b48078038d70f678a93eb"}]}] Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bf37c9d0240b48078038d70f678a93eb Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-946369439 Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: f041449191c94a5ca5a38c29dd146a15 Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-ServerRescueNegativeTestJSON-946369439-project Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance ade71e5a-f39d-4c61-8364-fd629f524922 could not be found. Jun 23 20:12:05.012411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'ade71e5a-f39d-4c61-8364-fd629f524922'} Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade71e5a-f39d-4c61-8364-fd629f524922 could not be found. Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:12:05.013320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade71e5a-f39d-4c61-8364-fd629f524922 could not be found. Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade71e5a-f39d-4c61-8364-fd629f524922 could not be found. Jun 23 20:12:05.014525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:12:05.015625 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] Returning 404 to user: Instance ade71e5a-f39d-4c61-8364-fd629f524922 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:12:05.015625 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b3c3c432-a0ae-47b7-ad6f-11e2d7bc95f1 tempest-ServerRescueNegativeTestJSON-946369439 tempest-ServerRescueNegativeTestJSON-946369439-project] 10.222.0.44 "GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922" status: 404 len: 111 microversion: 2.1 time: 0.030087 Jun 23 20:12:05.015625 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 325/635] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:04 2022] GET /compute/v2.1/servers/ade71e5a-f39d-4c61-8364-fd629f524922 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:12:05.536773 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-15627519-8d64-4f63-82cb-624dd4b0f94a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:05.537694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-15627519-8d64-4f63-82cb-624dd4b0f94a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:05.544692 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-15627519-8d64-4f63-82cb-624dd4b0f94a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:05.545154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-15627519-8d64-4f63-82cb-624dd4b0f94a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:05.545921 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-15627519-8d64-4f63-82cb-624dd4b0f94a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:05.546955 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-15627519-8d64-4f63-82cb-624dd4b0f94a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:05.575029 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-15627519-8d64-4f63-82cb-624dd4b0f94a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042266 Jun 23 20:12:05.575584 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 311/636] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:12:05 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 20:12:05.632827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9fd58e2c-3dee-49a2-ba53-1886e8c9b576 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:05.633312 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9fd58e2c-3dee-49a2-ba53-1886e8c9b576 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:05.639272 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9fd58e2c-3dee-49a2-ba53-1886e8c9b576 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:05.639712 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9fd58e2c-3dee-49a2-ba53-1886e8c9b576 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:05.641052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9fd58e2c-3dee-49a2-ba53-1886e8c9b576 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:05.641479 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9fd58e2c-3dee-49a2-ba53-1886e8c9b576 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:05.666330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9fd58e2c-3dee-49a2-ba53-1886e8c9b576 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:12:05.699869 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:05.954877 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9fd58e2c-3dee-49a2-ba53-1886e8c9b576 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 204 len: 0 microversion: 2.1 time: 0.325473 Jun 23 20:12:05.955724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 326/637] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:12:05 2022] DELETE /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 20:12:05.963738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-19d668aa-edb1-4cfd-9ca1-fa0e23d2aa7f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:05.974196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-19d668aa-edb1-4cfd-9ca1-fa0e23d2aa7f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:05.974196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19d668aa-edb1-4cfd-9ca1-fa0e23d2aa7f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:05.974196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19d668aa-edb1-4cfd-9ca1-fa0e23d2aa7f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:05.974196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19d668aa-edb1-4cfd-9ca1-fa0e23d2aa7f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:05.974615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19d668aa-edb1-4cfd-9ca1-fa0e23d2aa7f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:06.152668 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-19d668aa-edb1-4cfd-9ca1-fa0e23d2aa7f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:06.162170 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-19d668aa-edb1-4cfd-9ca1-fa0e23d2aa7f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1679 microversion: 2.1 time: 0.202266 Jun 23 20:12:06.172849 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 312/638] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:05 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:07.181062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-aeba245d-9cd0-41df-b8b9-952273cc1140 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:07.181784 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-aeba245d-9cd0-41df-b8b9-952273cc1140 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:07.188405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-aeba245d-9cd0-41df-b8b9-952273cc1140 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:07.188934 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-aeba245d-9cd0-41df-b8b9-952273cc1140 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:07.189706 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-aeba245d-9cd0-41df-b8b9-952273cc1140 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:07.190145 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-aeba245d-9cd0-41df-b8b9-952273cc1140 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:07.350704 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-aeba245d-9cd0-41df-b8b9-952273cc1140 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:07.358940 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-aeba245d-9cd0-41df-b8b9-952273cc1140 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1679 microversion: 2.1 time: 0.182535 Jun 23 20:12:07.359522 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 327/639] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:07 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:08.382306 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b6d3748b-5f5d-4448-935d-3e3521038bd2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:08.384894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b6d3748b-5f5d-4448-935d-3e3521038bd2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:08.409122 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b6d3748b-5f5d-4448-935d-3e3521038bd2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:08.409988 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b6d3748b-5f5d-4448-935d-3e3521038bd2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:08.411012 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b6d3748b-5f5d-4448-935d-3e3521038bd2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:08.411664 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b6d3748b-5f5d-4448-935d-3e3521038bd2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:08.749561 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b6d3748b-5f5d-4448-935d-3e3521038bd2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:08.772961 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b6d3748b-5f5d-4448-935d-3e3521038bd2 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1679 microversion: 2.1 time: 0.397105 Jun 23 20:12:08.782872 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 313/640] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:08 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1679 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:09.279157 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-53b58750-df13-4a16-a47f-01a2edfdaf6e req-23881c5c-982f-4a12-a958-2b58344a0b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dadba6-4a1e-4c0d-8342-b999e026e0da", "name": "network-vif-deleted", "tag": "7d7b074f-6236-41b4-80e6-37254c2b5b60"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:09.288818 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-53b58750-df13-4a16-a47f-01a2edfdaf6e req-23881c5c-982f-4a12-a958-2b58344a0b04 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:09.289334 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-53b58750-df13-4a16-a47f-01a2edfdaf6e req-23881c5c-982f-4a12-a958-2b58344a0b04 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:09.300900 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-53b58750-df13-4a16-a47f-01a2edfdaf6e req-23881c5c-982f-4a12-a958-2b58344a0b04 service nova] Creating event network-vif-deleted:7d7b074f-6236-41b4-80e6-37254c2b5b60 for instance a0dadba6-4a1e-4c0d-8342-b999e026e0da on hv-cinder-84727 Jun 23 20:12:09.305873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-53b58750-df13-4a16-a47f-01a2edfdaf6e req-23881c5c-982f-4a12-a958-2b58344a0b04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030903 Jun 23 20:12:09.306486 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 328/641] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:09.789422 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8ec66b57-c542-4c38-b447-f19d5089e7af tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:09.790023 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8ec66b57-c542-4c38-b447-f19d5089e7af tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:09.796603 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ec66b57-c542-4c38-b447-f19d5089e7af tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:09.797051 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ec66b57-c542-4c38-b447-f19d5089e7af tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:09.797804 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ec66b57-c542-4c38-b447-f19d5089e7af tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:09.798231 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8ec66b57-c542-4c38-b447-f19d5089e7af tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:09.861758 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8ec66b57-c542-4c38-b447-f19d5089e7af tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:09.869304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8ec66b57-c542-4c38-b447-f19d5089e7af tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1326 microversion: 2.1 time: 0.083863 Jun 23 20:12:09.869864 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 314/642] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:09 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1326 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:10.887465 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:10.888155 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:10.894918 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:10.895364 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:10.896133 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:10.896581 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:10.926841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:10.927285 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:10.927729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lazy-loading 'fault' on Instance uuid a0dadba6-4a1e-4c0d-8342-b999e026e0da {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:12:10.983371 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:10.997228 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-33d1b61c-cb98-48b9-88f1-88563e4aa96e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 200 len: 1331 microversion: 2.1 time: 0.107163 Jun 23 20:12:10.997228 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 329/643] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:10 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:12.007267 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:12.007875 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:12.010335 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:12.015796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:12.016244 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:12.017642 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:12.017642 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:12.031335 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da HTTP/1.1 Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:12:12.032923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:12:12.034573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'a0dadba6-4a1e-4c0d-8342-b999e026e0da'} Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:12:12.035379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:12:12.036615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:12:12.037773 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:12:12.037773 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5ba6587a-1c9a-4cef-bf78-61fdca33b785 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 404 len: 111 microversion: 2.1 time: 0.031157 Jun 23 20:12:12.037773 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 315/644] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:12 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:12:12.043523 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5d6d732f-25fe-414f-9a05-29f711b402a3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '.version_select at 0x7f90d9f35f70>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:12.139915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5d6d732f-25fe-414f-9a05-29f711b402a3 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994307435" status: 202 len: 0 microversion: 2.1 time: 0.100149 Jun 23 20:12:12.140607 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 330/645] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 23 20:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994307435 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:12:12.975678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a6dd26e5-79f8-416c-b7b5-d323ffcdadbc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: .version_select at 0x7f90d9dcdca0>, body: {"keypair": {"name": "tempest-keypair-1284338739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgL9DWI9rPwd4qoOu3X7ZNma8Gxpt+Re8rytRTyTO0qieEf6Q/WBRpSC49vtB7JIbgBGw1yOR3QtRtWID9V1XISELqbKq6FvYhLJrbgzaGvdnzx9tKy9ZG/JXhXK3bCdg=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:12.990882 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-a6dd26e5-79f8-416c-b7b5-d323ffcdadbc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for project bd810755b80346ae9219a2d0c61a8a06. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:12:12.995077 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-a6dd26e5-79f8-416c-b7b5-d323ffcdadbc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for user 8a5b19c8c0d44e1f93bb1dea72884cc3 and project bd810755b80346ae9219a2d0c61a8a06. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:12:13.097684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a6dd26e5-79f8-416c-b7b5-d323ffcdadbc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125890 Jun 23 20:12:13.101401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 316/646] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:12:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:16.413128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-311483973", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2163b477-2f70-4f87-a2ba-0f833320ac92"}], "security_groups": [{"name": "tempest-securitygroup--1773957851"}], "key_name": "tempest-keypair-1284338739", "user_data": "}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:16.543470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] validate_networks() for [('2163b477-2f70-4f87-a2ba-0f833320ac92', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:12:16.954930 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:12:16.960693 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:12:16.961181 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:12:16.961591 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:12:16.962937 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:12:16.972283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:16.972759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:16.973556 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:16.973987 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:16.998482 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for project bd810755b80346ae9219a2d0c61a8a06. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:12:17.003805 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Getting quotas for user 8a5b19c8c0d44e1f93bb1dea72884cc3 and project bd810755b80346ae9219a2d0c61a8a06. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:12:17.017783 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:12:17.020603 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:12:17.210023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a1f1a2ee-21c8-44cb-be47-9a83644b91f7 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.802561 Jun 23 20:12:17.210969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 331/647] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:12:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:12:17.228367 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e4360295-0972-414c-b832-52ac32e7024c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:17.229991 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e4360295-0972-414c-b832-52ac32e7024c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:17.321760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e4360295-0972-414c-b832-52ac32e7024c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:17.330100 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e4360295-0972-414c-b832-52ac32e7024c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1241 microversion: 2.1 time: 0.108969 Jun 23 20:12:17.331293 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 317/648] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:17 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:17.386215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5e43e95f-3b8c-4f97-a3ef-1d2cbeee411f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'create', calling method: .version_select at 0x7f90d9f50430>, body: {"keypair": {"name": "tempest-keypair-326423697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKtmR/TmGJOSHzP5FODBSQeiMXVZ042g/jcdefFpb9eFInWKWEyg5s6qoMbw6+Uf6FAkJi6apxo6vxGEGbUtPcoFl+8Y/V5TD/tGVFAhapkoC62wvORrAZqs79T4GNwGw=="}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:17.401212 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-5e43e95f-3b8c-4f97-a3ef-1d2cbeee411f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Getting quotas for project ed44d3eff7af4bd1bc339244e2bc2fae. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:12:17.405193 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-5e43e95f-3b8c-4f97-a3ef-1d2cbeee411f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Getting quotas for user 2c5e6ea89435497c8b1b06f42e08c82e and project ed44d3eff7af4bd1bc339244e2bc2fae. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:12:17.506000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5e43e95f-3b8c-4f97-a3ef-1d2cbeee411f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.270210 Jun 23 20:12:17.506681 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 332/649] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:12:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:18.347665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f2818c8a-6739-4237-a6da-6d9067e03485 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:18.348210 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f2818c8a-6739-4237-a6da-6d9067e03485 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:18.354288 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f2818c8a-6739-4237-a6da-6d9067e03485 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:18.354727 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f2818c8a-6739-4237-a6da-6d9067e03485 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:18.355485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f2818c8a-6739-4237-a6da-6d9067e03485 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:18.355917 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f2818c8a-6739-4237-a6da-6d9067e03485 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:18.418005 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f2818c8a-6739-4237-a6da-6d9067e03485 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:18.426100 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f2818c8a-6739-4237-a6da-6d9067e03485 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1245 microversion: 2.1 time: 0.082973 Jun 23 20:12:18.426895 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 318/650] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:18 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:19.443475 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7abeea66-66d6-48b6-96bb-700815caecdb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:19.444759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7abeea66-66d6-48b6-96bb-700815caecdb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:19.470107 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7abeea66-66d6-48b6-96bb-700815caecdb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:19.471297 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7abeea66-66d6-48b6-96bb-700815caecdb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:19.472274 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7abeea66-66d6-48b6-96bb-700815caecdb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:19.472940 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7abeea66-66d6-48b6-96bb-700815caecdb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:19.672685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7abeea66-66d6-48b6-96bb-700815caecdb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:19.692728 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7abeea66-66d6-48b6-96bb-700815caecdb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1301 microversion: 2.1 time: 0.253606 Jun 23 20:12:19.705320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 333/651] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:19 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1301 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:19.945716 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1100369226", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d5d57f3-4510-4872-96be-48a3a247b8dc"}], "security_groups": [{"name": "tempest-securitygroup--2135216895"}], "key_name": "tempest-keypair-326423697", "user_data": "}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:20.243836 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] validate_networks() for [('6d5d57f3-4510-4872-96be-48a3a247b8dc', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:12:20.711087 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-82bb39e3-2041-431f-b0f0-659ae6a945c0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:20.711633 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-82bb39e3-2041-431f-b0f0-659ae6a945c0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:20.717621 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82bb39e3-2041-431f-b0f0-659ae6a945c0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:20.720241 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82bb39e3-2041-431f-b0f0-659ae6a945c0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:20.720241 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82bb39e3-2041-431f-b0f0-659ae6a945c0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:20.720241 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-82bb39e3-2041-431f-b0f0-659ae6a945c0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:20.997759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-82bb39e3-2041-431f-b0f0-659ae6a945c0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:21.005802 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-82bb39e3-2041-431f-b0f0-659ae6a945c0 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1367 microversion: 2.1 time: 0.298679 Jun 23 20:12:21.006687 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 334/652] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:20 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:21.010119 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:12:21.011178 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:12:21.011805 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:12:21.012394 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:12:21.012976 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:12:21.022854 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:21.023303 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:21.024130 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:21.026374 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:21.031377 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:21.041876 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Getting quotas for project ed44d3eff7af4bd1bc339244e2bc2fae. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:12:21.045994 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Getting quotas for user 2c5e6ea89435497c8b1b06f42e08c82e and project ed44d3eff7af4bd1bc339244e2bc2fae. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:12:21.056946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:12:21.059204 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:12:21.221420 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0bfdd562-c64c-4e8f-aaa6-2dd352efe6a6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.280394 Jun 23 20:12:21.222165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 319/653] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:12:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:12:21.231908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e2ce11a0-fd65-4e8e-81cb-eee3b45d2522 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:21.232545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e2ce11a0-fd65-4e8e-81cb-eee3b45d2522 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:21.303813 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e2ce11a0-fd65-4e8e-81cb-eee3b45d2522 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:21.311388 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e2ce11a0-fd65-4e8e-81cb-eee3b45d2522 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1237 microversion: 2.1 time: 0.083230 Jun 23 20:12:21.312001 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 335/654] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:21 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:21.895471 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-4ee09ff1-d791-437c-857c-6e89bea28676 req-af712982-6309-42b8-bd5e-1f80d328bc62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce09a9c-e549-437f-bf4a-798772ff530a", "tag": "e2d0b98f-658e-4a67-b7b7-f295d7433972"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:21.907200 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-4ee09ff1-d791-437c-857c-6e89bea28676 req-af712982-6309-42b8-bd5e-1f80d328bc62 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:21.908048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-4ee09ff1-d791-437c-857c-6e89bea28676 req-af712982-6309-42b8-bd5e-1f80d328bc62 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:21.921861 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-4ee09ff1-d791-437c-857c-6e89bea28676 req-af712982-6309-42b8-bd5e-1f80d328bc62 service nova] Creating event network-changed:e2d0b98f-658e-4a67-b7b7-f295d7433972 for instance 3ce09a9c-e549-437f-bf4a-798772ff530a on hv-cinder-84727 Jun 23 20:12:21.927718 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-4ee09ff1-d791-437c-857c-6e89bea28676 req-af712982-6309-42b8-bd5e-1f80d328bc62 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036161 Jun 23 20:12:21.928361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 320/655] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:22.023323 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a9b7ef7f-2323-43c2-b9d3-d1e81bc0ddf1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:22.023921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a9b7ef7f-2323-43c2-b9d3-d1e81bc0ddf1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:22.031062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9b7ef7f-2323-43c2-b9d3-d1e81bc0ddf1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:22.031501 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9b7ef7f-2323-43c2-b9d3-d1e81bc0ddf1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:22.032292 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9b7ef7f-2323-43c2-b9d3-d1e81bc0ddf1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:22.032740 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9b7ef7f-2323-43c2-b9d3-d1e81bc0ddf1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:22.237910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a9b7ef7f-2323-43c2-b9d3-d1e81bc0ddf1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:22.246731 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a9b7ef7f-2323-43c2-b9d3-d1e81bc0ddf1 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1367 microversion: 2.1 time: 0.225260 Jun 23 20:12:22.247555 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 336/656] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:22 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:12:22.329981 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ad30e325-8d5a-4577-9d01-39262f7de63e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:22.330699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ad30e325-8d5a-4577-9d01-39262f7de63e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:22.393709 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ad30e325-8d5a-4577-9d01-39262f7de63e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:22.400262 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ad30e325-8d5a-4577-9d01-39262f7de63e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1237 microversion: 2.1 time: 0.075716 Jun 23 20:12:22.401093 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 321/657] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:22 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:12:23.267251 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a69ce382-99b3-4904-9321-700ce486b262 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:23.268200 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a69ce382-99b3-4904-9321-700ce486b262 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:23.274416 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a69ce382-99b3-4904-9321-700ce486b262 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:23.274857 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a69ce382-99b3-4904-9321-700ce486b262 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:23.275607 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a69ce382-99b3-4904-9321-700ce486b262 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:23.276033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a69ce382-99b3-4904-9321-700ce486b262 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:23.403990 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a69ce382-99b3-4904-9321-700ce486b262 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:23.411242 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a69ce382-99b3-4904-9321-700ce486b262 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1367 microversion: 2.1 time: 0.148482 Jun 23 20:12:23.411842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 337/658] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:23 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:23.416749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-262bee71-62fa-4158-9f90-41af54382cf0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:23.417351 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-262bee71-62fa-4158-9f90-41af54382cf0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:23.424448 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-262bee71-62fa-4158-9f90-41af54382cf0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:23.424899 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-262bee71-62fa-4158-9f90-41af54382cf0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:23.425645 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-262bee71-62fa-4158-9f90-41af54382cf0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:23.426071 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-262bee71-62fa-4158-9f90-41af54382cf0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:23.485641 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-262bee71-62fa-4158-9f90-41af54382cf0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:23.493065 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-262bee71-62fa-4158-9f90-41af54382cf0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1289 microversion: 2.1 time: 0.080088 Jun 23 20:12:23.493559 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 322/659] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:23 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:24.428211 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-59a38bdc-962c-4ff9-a3bd-c00cd000f980 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:24.428937 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-59a38bdc-962c-4ff9-a3bd-c00cd000f980 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:24.435823 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-59a38bdc-962c-4ff9-a3bd-c00cd000f980 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:24.436270 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-59a38bdc-962c-4ff9-a3bd-c00cd000f980 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:24.437051 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-59a38bdc-962c-4ff9-a3bd-c00cd000f980 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:24.437490 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-59a38bdc-962c-4ff9-a3bd-c00cd000f980 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:24.509962 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6e576179-4b1e-4931-8d4c-78cee754daaa tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:24.510850 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6e576179-4b1e-4931-8d4c-78cee754daaa tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:24.517920 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6e576179-4b1e-4931-8d4c-78cee754daaa tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:24.518381 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6e576179-4b1e-4931-8d4c-78cee754daaa tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:24.519146 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6e576179-4b1e-4931-8d4c-78cee754daaa tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:24.519587 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6e576179-4b1e-4931-8d4c-78cee754daaa tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:24.591484 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6e576179-4b1e-4931-8d4c-78cee754daaa tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:24.601376 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6e576179-4b1e-4931-8d4c-78cee754daaa tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1307 microversion: 2.1 time: 0.093658 Jun 23 20:12:24.601376 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 323/660] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:24 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:12:24.629393 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-59a38bdc-962c-4ff9-a3bd-c00cd000f980 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:24.636782 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-59a38bdc-962c-4ff9-a3bd-c00cd000f980 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1367 microversion: 2.1 time: 0.212364 Jun 23 20:12:24.637276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 338/661] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:24 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:12:25.615836 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-463d4a80-8ad3-45c6-953f-0403920b9a3e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:25.617177 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-463d4a80-8ad3-45c6-953f-0403920b9a3e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:25.623490 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-463d4a80-8ad3-45c6-953f-0403920b9a3e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:25.624137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-463d4a80-8ad3-45c6-953f-0403920b9a3e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:25.625185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-463d4a80-8ad3-45c6-953f-0403920b9a3e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:25.625916 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-463d4a80-8ad3-45c6-953f-0403920b9a3e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:25.686228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d9da9a4b-3c60-4a38-aa77-23bd74c9ddde tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:25.694202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d9da9a4b-3c60-4a38-aa77-23bd74c9ddde tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:25.694202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9da9a4b-3c60-4a38-aa77-23bd74c9ddde tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:25.694202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9da9a4b-3c60-4a38-aa77-23bd74c9ddde tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:25.694202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9da9a4b-3c60-4a38-aa77-23bd74c9ddde tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:25.694672 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d9da9a4b-3c60-4a38-aa77-23bd74c9ddde tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:25.721528 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d9da9a4b-3c60-4a38-aa77-23bd74c9ddde tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/ips" status: 200 len: 152 microversion: 2.20 time: 0.163699 Jun 23 20:12:25.727468 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 324/662] 10.222.0.44 () {60 vars in 1288 bytes} [Thu Jun 23 20:12:25 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/ips => generated 152 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 20:12:25.732845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3ffb3efa-0475-4072-8c41-fc949100db6b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:25.734325 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3ffb3efa-0475-4072-8c41-fc949100db6b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:25.740829 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3ffb3efa-0475-4072-8c41-fc949100db6b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:25.741292 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3ffb3efa-0475-4072-8c41-fc949100db6b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:25.742071 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3ffb3efa-0475-4072-8c41-fc949100db6b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:25.742524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3ffb3efa-0475-4072-8c41-fc949100db6b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:25.885812 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-463d4a80-8ad3-45c6-953f-0403920b9a3e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:25.894178 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-463d4a80-8ad3-45c6-953f-0403920b9a3e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1363 microversion: 2.1 time: 0.282199 Jun 23 20:12:25.903125 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 339/663] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:25 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:12:25.984047 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3ffb3efa-0475-4072-8c41-fc949100db6b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:25.991429 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3ffb3efa-0475-4072-8c41-fc949100db6b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1367 microversion: 2.1 time: 0.265579 Jun 23 20:12:25.991987 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 325/664] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:25 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:26.107143 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-ae06a702-5c65-424f-9ea3-7f7df01617ec req-54f7f4a5-3e3d-4e04-a0f1-e473b78c3d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c7d315-1803-43d6-929e-04e171f188a6", "tag": "37c366c8-9439-4104-b866-3fbe24deff6b"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:26.115663 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-ae06a702-5c65-424f-9ea3-7f7df01617ec req-54f7f4a5-3e3d-4e04-a0f1-e473b78c3d7c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:26.116426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-ae06a702-5c65-424f-9ea3-7f7df01617ec req-54f7f4a5-3e3d-4e04-a0f1-e473b78c3d7c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:26.127948 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-ae06a702-5c65-424f-9ea3-7f7df01617ec req-54f7f4a5-3e3d-4e04-a0f1-e473b78c3d7c service nova] Creating event network-changed:37c366c8-9439-4104-b866-3fbe24deff6b for instance 94c7d315-1803-43d6-929e-04e171f188a6 on hv-cinder-84727 Jun 23 20:12:26.134053 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-ae06a702-5c65-424f-9ea3-7f7df01617ec req-54f7f4a5-3e3d-4e04-a0f1-e473b78c3d7c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031051 Jun 23 20:12:26.134650 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 340/665] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:12:26.917284 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2f0fcfae-f7b5-4bae-b2a0-1840b15831db tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:26.917884 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2f0fcfae-f7b5-4bae-b2a0-1840b15831db tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:26.925352 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2f0fcfae-f7b5-4bae-b2a0-1840b15831db tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:26.925796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2f0fcfae-f7b5-4bae-b2a0-1840b15831db tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:26.926568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2f0fcfae-f7b5-4bae-b2a0-1840b15831db tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:26.926999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2f0fcfae-f7b5-4bae-b2a0-1840b15831db tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:27.005735 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:27.010619 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2eab7fea-57bc-488c-bb93-38da7559deb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:27.011310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2eab7fea-57bc-488c-bb93-38da7559deb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:27.018179 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2eab7fea-57bc-488c-bb93-38da7559deb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:27.019924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2eab7fea-57bc-488c-bb93-38da7559deb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:27.019924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2eab7fea-57bc-488c-bb93-38da7559deb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:27.019924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2eab7fea-57bc-488c-bb93-38da7559deb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:27.219146 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2f0fcfae-f7b5-4bae-b2a0-1840b15831db tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:27.227306 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2f0fcfae-f7b5-4bae-b2a0-1840b15831db tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1363 microversion: 2.1 time: 0.314032 Jun 23 20:12:27.243134 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 326/666] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:26 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:27.276383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2eab7fea-57bc-488c-bb93-38da7559deb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:27.284971 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2eab7fea-57bc-488c-bb93-38da7559deb9 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1367 microversion: 2.1 time: 0.280161 Jun 23 20:12:27.285536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 341/667] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:27 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:12:28.185451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5a2c4cf3-9682-4fc3-817b-8d7092ccf1d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:28.185982 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5a2c4cf3-9682-4fc3-817b-8d7092ccf1d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:28.193017 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a2c4cf3-9682-4fc3-817b-8d7092ccf1d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:28.193466 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a2c4cf3-9682-4fc3-817b-8d7092ccf1d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:28.194229 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a2c4cf3-9682-4fc3-817b-8d7092ccf1d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:28.194664 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a2c4cf3-9682-4fc3-817b-8d7092ccf1d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:28.217270 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-5a2c4cf3-9682-4fc3-817b-8d7092ccf1d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lazy-loading 'flavor' on Instance uuid dbfc5144-0d0f-4d88-bfef-d92a270ca655 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:12:28.250462 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1edf36af-0e22-4360-9568-af0b1143491c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:28.251160 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1edf36af-0e22-4360-9568-af0b1143491c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:28.257646 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1edf36af-0e22-4360-9568-af0b1143491c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:28.257646 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1edf36af-0e22-4360-9568-af0b1143491c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:28.258392 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1edf36af-0e22-4360-9568-af0b1143491c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:28.258826 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1edf36af-0e22-4360-9568-af0b1143491c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:28.400988 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1edf36af-0e22-4360-9568-af0b1143491c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:28.408974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1edf36af-0e22-4360-9568-af0b1143491c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1363 microversion: 2.1 time: 0.162894 Jun 23 20:12:28.409723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 342/668] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:28 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:12:28.414142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4ee165aa-f83d-4a17-9c54-89d264b79235 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:28.414736 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4ee165aa-f83d-4a17-9c54-89d264b79235 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:28.420403 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4ee165aa-f83d-4a17-9c54-89d264b79235 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:28.420853 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4ee165aa-f83d-4a17-9c54-89d264b79235 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:28.421631 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4ee165aa-f83d-4a17-9c54-89d264b79235 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:28.422068 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4ee165aa-f83d-4a17-9c54-89d264b79235 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:28.553334 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4ee165aa-f83d-4a17-9c54-89d264b79235 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:28.562430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4ee165aa-f83d-4a17-9c54-89d264b79235 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1367 microversion: 2.1 time: 0.151213 Jun 23 20:12:28.562990 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 343/669] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:28 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:28.567371 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-5266d0bc-7148-4cad-a11b-083b9da5d92d req-14b07dbc-3dfb-4095-9737-acee35a1dd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce09a9c-e549-437f-bf4a-798772ff530a", "name": "network-vif-plugged", "status": "completed", "tag": "e2d0b98f-658e-4a67-b7b7-f295d7433972"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:28.574954 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-5266d0bc-7148-4cad-a11b-083b9da5d92d req-14b07dbc-3dfb-4095-9737-acee35a1dd27 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:28.575393 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-5266d0bc-7148-4cad-a11b-083b9da5d92d req-14b07dbc-3dfb-4095-9737-acee35a1dd27 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:28.588002 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-5266d0bc-7148-4cad-a11b-083b9da5d92d req-14b07dbc-3dfb-4095-9737-acee35a1dd27 service nova] Creating event network-vif-plugged:e2d0b98f-658e-4a67-b7b7-f295d7433972 for instance 3ce09a9c-e549-437f-bf4a-798772ff530a on hv-cinder-84727 Jun 23 20:12:28.592847 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-5266d0bc-7148-4cad-a11b-083b9da5d92d req-14b07dbc-3dfb-4095-9737-acee35a1dd27 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028694 Jun 23 20:12:28.593343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 344/670] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:28.821716 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5a2c4cf3-9682-4fc3-817b-8d7092ccf1d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/action" status: 202 len: 0 microversion: 2.20 time: 0.640049 Jun 23 20:12:28.822345 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 327/671] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jun 23 20:12:28 2022] POST /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:12:28.832104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:28.832815 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:28.838962 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:28.839410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:28.842069 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:28.842069 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:29.001472 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:29.009592 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:29.011110 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:29.012261 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e1bf6c8b-fd69-4395-ae55-8f3e976a168d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.185451 Jun 23 20:12:29.012843 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 345/672] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:28 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:29.429382 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1463322f-1362-438b-b835-2ba5039c44b3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:29.430082 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1463322f-1362-438b-b835-2ba5039c44b3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:29.436404 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1463322f-1362-438b-b835-2ba5039c44b3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:29.436874 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1463322f-1362-438b-b835-2ba5039c44b3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:29.437636 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1463322f-1362-438b-b835-2ba5039c44b3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:29.438073 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1463322f-1362-438b-b835-2ba5039c44b3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:29.570487 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1463322f-1362-438b-b835-2ba5039c44b3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:29.578463 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1463322f-1362-438b-b835-2ba5039c44b3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1363 microversion: 2.1 time: 0.153907 Jun 23 20:12:29.579284 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 328/673] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:29 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:29.579628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b9cc59a8-c55a-416c-bf47-b30fb352d7fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:29.580265 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b9cc59a8-c55a-416c-bf47-b30fb352d7fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:29.586298 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9cc59a8-c55a-416c-bf47-b30fb352d7fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:29.588825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9cc59a8-c55a-416c-bf47-b30fb352d7fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:29.588825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9cc59a8-c55a-416c-bf47-b30fb352d7fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:29.588825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9cc59a8-c55a-416c-bf47-b30fb352d7fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:29.713336 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b9cc59a8-c55a-416c-bf47-b30fb352d7fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:29.721282 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b9cc59a8-c55a-416c-bf47-b30fb352d7fd tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1367 microversion: 2.1 time: 0.146285 Jun 23 20:12:29.721849 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 346/674] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:29 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:12:30.030557 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:30.031160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:30.037221 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:30.037665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:30.038415 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:30.038847 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:30.167025 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:30.176081 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:30.177719 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:30.178936 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-842b5383-18bd-4fb4-8729-2d8970139302 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.152259 Jun 23 20:12:30.179538 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 329/675] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:30 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:30.594987 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-668d80b4-2efc-48a8-b95c-90fb44602d19 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:30.595556 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-668d80b4-2efc-48a8-b95c-90fb44602d19 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:30.601898 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-668d80b4-2efc-48a8-b95c-90fb44602d19 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:30.602350 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-668d80b4-2efc-48a8-b95c-90fb44602d19 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:30.603134 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-668d80b4-2efc-48a8-b95c-90fb44602d19 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:30.603570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-668d80b4-2efc-48a8-b95c-90fb44602d19 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:30.737903 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-668d80b4-2efc-48a8-b95c-90fb44602d19 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:30.738782 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6069a8ad-73f3-49b7-827d-659e79827926 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:30.739530 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6069a8ad-73f3-49b7-827d-659e79827926 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:30.745790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-668d80b4-2efc-48a8-b95c-90fb44602d19 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1363 microversion: 2.1 time: 0.154724 Jun 23 20:12:30.745966 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6069a8ad-73f3-49b7-827d-659e79827926 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:30.746362 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 347/676] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:30 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:30.748494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6069a8ad-73f3-49b7-827d-659e79827926 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:30.749424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6069a8ad-73f3-49b7-827d-659e79827926 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:30.749943 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6069a8ad-73f3-49b7-827d-659e79827926 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:30.879491 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6069a8ad-73f3-49b7-827d-659e79827926 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:30.887003 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6069a8ad-73f3-49b7-827d-659e79827926 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1557 microversion: 2.1 time: 0.153423 Jun 23 20:12:30.887602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 330/677] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:30 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:12:30.902999 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8e68d589-d8c0-4f5f-823b-948417a16222 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:30.903490 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8e68d589-d8c0-4f5f-823b-948417a16222 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:30.909974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8e68d589-d8c0-4f5f-823b-948417a16222 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:30.910424 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8e68d589-d8c0-4f5f-823b-948417a16222 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:30.911209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8e68d589-d8c0-4f5f-823b-948417a16222 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:30.911645 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8e68d589-d8c0-4f5f-823b-948417a16222 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:30.915363 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:30.986842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8e68d589-d8c0-4f5f-823b-948417a16222 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087600 Jun 23 20:12:30.987471 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 348/678] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 23 20:12:30 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:31.198346 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:31.199037 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:31.201334 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:31.207332 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:31.207855 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:31.211814 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:31.211814 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:31.450576 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:31.459285 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:31.460834 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:31.461993 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be999665-461c-4962-802a-fee00a124777 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.267616 Jun 23 20:12:31.462534 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 331/679] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:31 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:31.759461 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=12 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:31.763397 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5cd778ff-b262-4327-a5d9-277a70c7ce57 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:31.764075 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5cd778ff-b262-4327-a5d9-277a70c7ce57 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:31.766575 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:31.771623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5cd778ff-b262-4327-a5d9-277a70c7ce57 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:31.771765 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5cd778ff-b262-4327-a5d9-277a70c7ce57 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:31.772564 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5cd778ff-b262-4327-a5d9-277a70c7ce57 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:31.773003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5cd778ff-b262-4327-a5d9-277a70c7ce57 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:31.986343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5cd778ff-b262-4327-a5d9-277a70c7ce57 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:31.993800 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5cd778ff-b262-4327-a5d9-277a70c7ce57 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1363 microversion: 2.1 time: 0.235082 Jun 23 20:12:31.994615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 349/680] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:31 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:32.086131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-9a9a71d9-5aaf-4b31-8601-b5df474b7bf7 req-1aa1cf92-885b-4382-bbef-d31e530f2f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce09a9c-e549-437f-bf4a-798772ff530a", "tag": "e2d0b98f-658e-4a67-b7b7-f295d7433972"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:32.096387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-9a9a71d9-5aaf-4b31-8601-b5df474b7bf7 req-1aa1cf92-885b-4382-bbef-d31e530f2f98 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:32.097443 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-9a9a71d9-5aaf-4b31-8601-b5df474b7bf7 req-1aa1cf92-885b-4382-bbef-d31e530f2f98 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:32.107561 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-9a9a71d9-5aaf-4b31-8601-b5df474b7bf7 req-1aa1cf92-885b-4382-bbef-d31e530f2f98 service nova] Creating event network-changed:e2d0b98f-658e-4a67-b7b7-f295d7433972 for instance 3ce09a9c-e549-437f-bf4a-798772ff530a on hv-cinder-84727 Jun 23 20:12:32.112955 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-9a9a71d9-5aaf-4b31-8601-b5df474b7bf7 req-1aa1cf92-885b-4382-bbef-d31e530f2f98 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030420 Jun 23 20:12:32.113508 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 332/681] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:32.480617 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:32.481588 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:32.488994 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:32.489556 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:32.490773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:32.491283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:32.581724 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=14 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:32.586204 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-319922f6-e3ed-4158-96cf-d2c910dea2e5 req-d9a6ba83-6a30-4ab2-a442-bd2d8c1a749d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c7d315-1803-43d6-929e-04e171f188a6", "name": "network-vif-plugged", "status": "completed", "tag": "37c366c8-9439-4104-b866-3fbe24deff6b"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:32.595242 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-319922f6-e3ed-4158-96cf-d2c910dea2e5 req-d9a6ba83-6a30-4ab2-a442-bd2d8c1a749d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:32.595810 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-319922f6-e3ed-4158-96cf-d2c910dea2e5 req-d9a6ba83-6a30-4ab2-a442-bd2d8c1a749d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:32.607395 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-319922f6-e3ed-4158-96cf-d2c910dea2e5 req-d9a6ba83-6a30-4ab2-a442-bd2d8c1a749d service nova] Creating event network-vif-plugged:37c366c8-9439-4104-b866-3fbe24deff6b for instance 94c7d315-1803-43d6-929e-04e171f188a6 on hv-cinder-84727 Jun 23 20:12:32.612843 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-319922f6-e3ed-4158-96cf-d2c910dea2e5 req-d9a6ba83-6a30-4ab2-a442-bd2d8c1a749d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031942 Jun 23 20:12:32.613600 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 333/682] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:32.708194 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:32.721195 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:32.722910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:32.724244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8e2fa3ba-e7e6-4c80-97aa-d4807a43a9bc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.247562 Jun 23 20:12:32.734975 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 350/683] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:32 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:33.011930 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-df5c3093-3e0a-464b-8801-8e1f54eb047a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:33.012767 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-df5c3093-3e0a-464b-8801-8e1f54eb047a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:33.020078 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-df5c3093-3e0a-464b-8801-8e1f54eb047a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:33.020577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-df5c3093-3e0a-464b-8801-8e1f54eb047a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:33.021348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-df5c3093-3e0a-464b-8801-8e1f54eb047a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:33.021787 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-df5c3093-3e0a-464b-8801-8e1f54eb047a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:33.168591 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-df5c3093-3e0a-464b-8801-8e1f54eb047a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:33.176768 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-df5c3093-3e0a-464b-8801-8e1f54eb047a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1363 microversion: 2.1 time: 0.169158 Jun 23 20:12:33.177373 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 334/684] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:33 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:33.742381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:33.742914 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:33.748954 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:33.749902 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:33.750650 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:33.751114 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:33.874790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:33.882590 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:33.884078 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:33.885244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-eda8be64-8938-47e2-bb9d-241204d50739 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.146843 Jun 23 20:12:33.885800 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 351/685] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:33 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:34.193748 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-215fee47-7e87-48ea-80d3-54edd01b6272 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:34.194356 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-215fee47-7e87-48ea-80d3-54edd01b6272 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:34.200803 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-215fee47-7e87-48ea-80d3-54edd01b6272 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:34.201248 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-215fee47-7e87-48ea-80d3-54edd01b6272 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:34.201996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-215fee47-7e87-48ea-80d3-54edd01b6272 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:34.202427 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-215fee47-7e87-48ea-80d3-54edd01b6272 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:34.330369 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-215fee47-7e87-48ea-80d3-54edd01b6272 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:34.337794 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-215fee47-7e87-48ea-80d3-54edd01b6272 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1363 microversion: 2.1 time: 0.147851 Jun 23 20:12:34.338359 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 335/686] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:34 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:34.903099 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:34.903638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:34.909701 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:34.910265 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:34.911029 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:34.911459 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:35.040796 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:35.049147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:35.050662 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:35.051809 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f54dc0d9-591d-4a6c-a4e7-cdb8ad6d85d0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.152815 Jun 23 20:12:35.052405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 352/687] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:34 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:35.354577 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1f105a25-00ea-4dc4-a3d0-e30ed37ef0c9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:35.355185 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1f105a25-00ea-4dc4-a3d0-e30ed37ef0c9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:35.362353 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f105a25-00ea-4dc4-a3d0-e30ed37ef0c9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:35.362805 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f105a25-00ea-4dc4-a3d0-e30ed37ef0c9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:35.363572 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f105a25-00ea-4dc4-a3d0-e30ed37ef0c9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:35.363992 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f105a25-00ea-4dc4-a3d0-e30ed37ef0c9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:35.488642 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1f105a25-00ea-4dc4-a3d0-e30ed37ef0c9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:35.496052 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1f105a25-00ea-4dc4-a3d0-e30ed37ef0c9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1549 microversion: 2.1 time: 0.145321 Jun 23 20:12:35.496598 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 336/688] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:12:35 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:12:35.512135 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3c214bf5-1640-440f-a874-d995d496fc6c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:35.512657 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3c214bf5-1640-440f-a874-d995d496fc6c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:35.518556 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3c214bf5-1640-440f-a874-d995d496fc6c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:35.518996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3c214bf5-1640-440f-a874-d995d496fc6c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:35.519736 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3c214bf5-1640-440f-a874-d995d496fc6c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:35.520169 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3c214bf5-1640-440f-a874-d995d496fc6c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:35.599291 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3c214bf5-1640-440f-a874-d995d496fc6c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090961 Jun 23 20:12:35.599884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 353/689] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 23 20:12:35 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:36.069902 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:36.070506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:36.078422 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:36.078866 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:36.079881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:36.080318 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:36.313351 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:36.316845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:36.325010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:36.325010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:36.325010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-10d6e79e-6134-44b1-858a-f66291021c82 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.258558 Jun 23 20:12:36.332731 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 337/690] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:36 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:36.942586 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-3c26c696-ed7b-4402-8390-94a5983b885e req-7d4d1b35-52d0-4675-a742-f725bd93b438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c7d315-1803-43d6-929e-04e171f188a6", "tag": "37c366c8-9439-4104-b866-3fbe24deff6b"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:36.950622 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3c26c696-ed7b-4402-8390-94a5983b885e req-7d4d1b35-52d0-4675-a742-f725bd93b438 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:36.951058 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3c26c696-ed7b-4402-8390-94a5983b885e req-7d4d1b35-52d0-4675-a742-f725bd93b438 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:36.962724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-3c26c696-ed7b-4402-8390-94a5983b885e req-7d4d1b35-52d0-4675-a742-f725bd93b438 service nova] Creating event network-changed:37c366c8-9439-4104-b866-3fbe24deff6b for instance 94c7d315-1803-43d6-929e-04e171f188a6 on hv-cinder-84727 Jun 23 20:12:36.967605 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-3c26c696-ed7b-4402-8390-94a5983b885e req-7d4d1b35-52d0-4675-a742-f725bd93b438 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028748 Jun 23 20:12:36.968741 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 354/691] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:12:37.344747 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:37.346076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:37.352892 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:37.353639 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:37.354638 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:37.355253 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:37.576250 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:37.585590 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:37.587151 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:37.589019 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2a13b75c-17f6-4de0-bf61-d1340f5c6bc3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.249054 Jun 23 20:12:37.593970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 338/692] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:37 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:12:38.609495 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:38.610098 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:38.616246 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:38.616717 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:38.617465 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:38.617896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:38.746909 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:38.755352 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:38.756880 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:38.758030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d3b7a43f-454a-4fa0-b8b8-e509e4db8ddc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.153638 Jun 23 20:12:38.758587 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 355/693] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:38 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:39.776411 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:39.777010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:39.783498 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:39.783939 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:39.784717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:39.785146 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:39.912004 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:39.919835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:39.921355 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:39.922494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-021ce5eb-d2f0-459b-ac85-ab88e7afa125 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.150178 Jun 23 20:12:39.923040 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 339/694] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:39 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:40.940078 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:40.940717 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:40.946787 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:40.947227 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:40.947975 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:40.948433 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:41.073232 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:41.081722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:41.083215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:41.084373 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2bb1a59d-1acd-4456-a8ea-cfaa6b2e8c2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.148178 Jun 23 20:12:41.084960 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 356/695] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:40 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:42.103111 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:42.103721 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:42.110679 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:42.111138 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:42.111900 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:42.112359 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:42.242204 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:42.250613 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:42.252134 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:42.253317 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8cf6538e-05d0-4246-911e-72722409fdd2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.154282 Jun 23 20:12:42.253874 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 340/696] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:42 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:43.271594 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:43.272197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:43.278363 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:43.278800 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:43.279548 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:43.279977 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:43.404644 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:43.413222 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:43.414698 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:43.415866 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c07bca6a-7516-47a1-8e8f-3f0fab0c6b60 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.148235 Jun 23 20:12:43.416444 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 357/697] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:43 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:44.434140 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:44.434747 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:44.441797 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:44.442259 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:44.442999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:44.443431 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:44.573493 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:44.581599 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:44.583101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:44.584251 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-65c278c3-75d9-4743-9402-1e5287e6ca2c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.153982 Jun 23 20:12:44.584845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 341/698] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:44 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:45.602257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:45.602853 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:45.608941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:45.609897 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:45.610674 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:45.611108 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:45.750586 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:45.758349 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:45.759832 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:45.761038 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-42fabf1f-6a49-4ab1-89a4-96c11fbb260a tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1745 microversion: 2.20 time: 0.162639 Jun 23 20:12:45.761593 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 358/699] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:45 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:46.780436 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:46.781039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:46.787617 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:46.788063 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:46.788848 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:46.789279 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:46.916987 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:46.925399 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:46.926886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:46.928034 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-04344c77-5980-48b0-8ae6-574574b7957e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1745 microversion: 2.20 time: 0.151527 Jun 23 20:12:46.928630 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 342/700] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:46 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:47.947079 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:47.947929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:47.955709 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:47.956554 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:47.957613 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:47.958120 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:48.109704 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:48.118133 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:48.119649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:48.120857 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8f15d3a5-b4e9-468c-addd-499de627cfa0 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.177655 Jun 23 20:12:48.132835 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 359/701] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:47 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:48.424746 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-8752d888-b7bb-465d-85d6-9586e5591d5e req-b3b02ec2-69dd-4a65-aa78-bfb922cd593d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfc5144-0d0f-4d88-bfef-d92a270ca655", "name": "network-vif-plugged", "status": "completed", "tag": "048e62b5-3005-46cb-96bf-1c13423b57db"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:12:48.429895 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:12:48.437529 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8752d888-b7bb-465d-85d6-9586e5591d5e req-b3b02ec2-69dd-4a65-aa78-bfb922cd593d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:48.438402 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8752d888-b7bb-465d-85d6-9586e5591d5e req-b3b02ec2-69dd-4a65-aa78-bfb922cd593d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:48.451884 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-8752d888-b7bb-465d-85d6-9586e5591d5e req-b3b02ec2-69dd-4a65-aa78-bfb922cd593d service nova] Creating event network-vif-plugged:048e62b5-3005-46cb-96bf-1c13423b57db for instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 on hv-cinder-84727 Jun 23 20:12:48.458921 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-8752d888-b7bb-465d-85d6-9586e5591d5e req-b3b02ec2-69dd-4a65-aa78-bfb922cd593d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038403 Jun 23 20:12:48.459557 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 343/702] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:12:49.140036 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:49.142396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:49.149257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:49.149783 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:49.150630 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:49.150883 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:49.293327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:49.301484 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:49.302949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:49.304093 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-de39fca8-1dbb-49b9-8783-762cb8f992ec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.167877 Jun 23 20:12:49.314694 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 360/703] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:49 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:50.323527 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:50.324215 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:50.331871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:50.332381 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:50.333135 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:50.333565 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:50.477747 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:50.485814 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:50.487301 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:50.488464 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9078bcb3-49b7-4143-948a-59a7e03e29fc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.169948 Jun 23 20:12:50.489017 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 344/704] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:50 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:51.508584 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:51.509106 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:51.515520 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:51.515960 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:51.516748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:51.517180 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:51.675157 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:51.683104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:51.684610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:51.685757 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-af5d7ecd-7c1a-4f2f-8fad-3760fa2d3866 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.181901 Jun 23 20:12:51.698371 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 361/705] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:51 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:52.707904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:52.708673 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:52.716390 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:52.716845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:52.717617 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:52.718059 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:52.859047 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:52.868627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:52.870167 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:52.871748 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0fce7b0a-c969-4056-8928-eea83815502b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.169683 Jun 23 20:12:52.882973 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 345/706] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:52 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:53.890868 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:53.891484 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:53.897590 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:53.898039 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:53.898797 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:53.899234 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:54.029285 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:54.037128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:54.038638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:54.039794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-13a9c89e-7881-4d34-9e90-834036f34f9b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.153337 Jun 23 20:12:54.040369 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 362/707] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:53 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:55.058767 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:55.059502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:55.069284 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:55.069871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:55.070654 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:55.071085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:55.215975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:55.224171 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:55.225686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:55.231977 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2ff80d9d-5a1b-422c-96c4-b722d77e698d tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.177436 Jun 23 20:12:55.247811 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 346/708] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:55 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:12:56.255729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:56.256987 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:56.263484 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:56.263966 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:56.264735 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:56.265203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:56.416008 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:56.424911 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:56.426425 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:56.427646 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-94bc21fa-6721-4d7d-b91f-6c0fa0ef5fb7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.176042 Jun 23 20:12:56.428506 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 363/709] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:56 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:57.447046 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:57.448527 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:57.455978 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:57.456460 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:57.457238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:57.457676 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:57.594859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:57.603321 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:57.604931 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:57.606294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5c08447e-0017-415d-bc1c-e71ffcdc5a27 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.163503 Jun 23 20:12:57.606928 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 347/710] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:57 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:58.624250 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:58.625409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:58.631429 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:58.631907 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:58.632681 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:58.633112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:58.764100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:58.772611 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:58.774113 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:58.775242 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-193a7ea1-3951-4c48-837c-0c880476ae0f tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1740 microversion: 2.20 time: 0.154898 Jun 23 20:12:58.775795 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 364/711] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:58 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:12:59.793371 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:12:59.793982 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:12:59.800599 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:59.801064 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:59.801826 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:12:59.802269 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:12:59.936455 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:59.944733 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:59.946239 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:12:59.947384 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c83ea0d2-0c4c-4fa2-9064-a5105c719f23 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1722 microversion: 2.20 time: 0.157870 Jun 23 20:12:59.947936 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 348/712] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:12:59 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:13:00.966736 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:00.967320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:00.973443 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:00.973895 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:00.974650 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:00.975086 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:00.979115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=93 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:01.099454 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:01.107508 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:01.109037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:01.110700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4b535f81-1952-4085-bddf-82ba7dcfbf71 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1722 microversion: 2.20 time: 0.147897 Jun 23 20:13:01.111258 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 365/713] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:00 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:02.130955 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:02.132574 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:02.138040 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:02.138480 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:02.139234 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:02.139680 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:02.269056 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:02.276871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:02.278371 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:02.279524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-db9434d5-d4cb-4cce-a986-601521e887c7 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1665 microversion: 2.20 time: 0.152467 Jun 23 20:13:02.280075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 349/714] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:02 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:02.296926 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c0023b95-b7a3-4e05-96a3-e1ad316a16d3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e314eca6-545e-44f5-879c-c5f26b88bc47"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:02.298105 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c0023b95-b7a3-4e05-96a3-e1ad316a16d3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:02.304067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c0023b95-b7a3-4e05-96a3-e1ad316a16d3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:02.305929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c0023b95-b7a3-4e05-96a3-e1ad316a16d3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:02.305929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c0023b95-b7a3-4e05-96a3-e1ad316a16d3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:02.305929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c0023b95-b7a3-4e05-96a3-e1ad316a16d3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:02.476393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-00efce86-63d4-4217-af3f-2d73a0d5317e req-0e366648-fd21-4317-b8ff-2fb5d8e8c6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfc5144-0d0f-4d88-bfef-d92a270ca655", "name": "network-vif-unplugged", "status": "completed", "tag": "048e62b5-3005-46cb-96bf-1c13423b57db"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:02.484446 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-00efce86-63d4-4217-af3f-2d73a0d5317e req-0e366648-fd21-4317-b8ff-2fb5d8e8c6f7 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:02.484893 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-00efce86-63d4-4217-af3f-2d73a0d5317e req-0e366648-fd21-4317-b8ff-2fb5d8e8c6f7 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:02.498720 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.compute.server_external_events [req-00efce86-63d4-4217-af3f-2d73a0d5317e req-0e366648-fd21-4317-b8ff-2fb5d8e8c6f7 service nova] Unable to find a host for instance dbfc5144-0d0f-4d88-bfef-d92a270ca655. Dropping event network-vif-unplugged {{(pid=118345) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 20:13:02.499593 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-00efce86-63d4-4217-af3f-2d73a0d5317e req-0e366648-fd21-4317-b8ff-2fb5d8e8c6f7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.079906 Jun 23 20:13:02.501141 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 350/715] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 23 20:13:03.278574 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c0023b95-b7a3-4e05-96a3-e1ad316a16d3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.985536 Jun 23 20:13:03.279180 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 366/716] 10.222.0.44 () {62 vars in 1363 bytes} [Thu Jun 23 20:13:02 2022] POST /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/os-volume_attachments => generated 188 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 20:13:03.390099 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c6fa8f82-ed9a-49d4-ab12-da32f257d463 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:03.390594 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c6fa8f82-ed9a-49d4-ab12-da32f257d463 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:03.397049 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c6fa8f82-ed9a-49d4-ab12-da32f257d463 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:03.397500 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c6fa8f82-ed9a-49d4-ab12-da32f257d463 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:03.398249 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c6fa8f82-ed9a-49d4-ab12-da32f257d463 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:03.398747 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c6fa8f82-ed9a-49d4-ab12-da32f257d463 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:03.992468 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c6fa8f82-ed9a-49d4-ab12-da32f257d463 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/os-volume_attachments/e314eca6-545e-44f5-879c-c5f26b88bc47" status: 202 len: 0 microversion: 2.20 time: 0.606234 Jun 23 20:13:03.992973 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 351/717] 10.222.0.44 () {60 vars in 1456 bytes} [Thu Jun 23 20:13:03 2022] DELETE /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/os-volume_attachments/e314eca6-545e-44f5-879c-c5f26b88bc47 => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:13:04.049420 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1a673e98-14e8-4ba3-b88f-817e58b55f2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:04.049984 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1a673e98-14e8-4ba3-b88f-817e58b55f2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:04.051917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=36 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:04.056716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1a673e98-14e8-4ba3-b88f-817e58b55f2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:04.064052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1a673e98-14e8-4ba3-b88f-817e58b55f2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:04.064052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1a673e98-14e8-4ba3-b88f-817e58b55f2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:04.064052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1a673e98-14e8-4ba3-b88f-817e58b55f2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:04.351641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1a673e98-14e8-4ba3-b88f-817e58b55f2e tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "POST /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/action" status: 202 len: 0 microversion: 2.20 time: 0.306633 Jun 23 20:13:04.352255 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 367/718] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jun 23 20:13:04 2022] POST /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:13:04.360553 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:04.361168 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:04.369611 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:04.370067 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:04.370846 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:04.371287 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:04.521220 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:04.531822 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:04.531822 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:04.532671 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fb3c115f-f2c6-4ecf-a242-953321754c29 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1673 microversion: 2.20 time: 0.176189 Jun 23 20:13:04.533331 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 352/719] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:04 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:05.553970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:05.554566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:05.560673 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:05.561128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:05.561873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:05.562953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:05.692379 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:05.700147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:05.701670 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:05.703312 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c571642e-6142-488c-9516-5457737547ae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1675 microversion: 2.20 time: 0.152961 Jun 23 20:13:05.703871 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 368/720] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:05 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:06.721974 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:06.722755 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:06.729024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:06.729472 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:06.730236 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:06.730671 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:06.745339 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:06.879021 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:06.886997 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:06.888583 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:06.889737 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d4b8e837-1950-4cb4-bcc7-def1b009c8e3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.171736 Jun 23 20:13:06.890329 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 353/721] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:06 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:07.915258 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:07.915915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:07.923320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:07.923762 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:07.924867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:07.925540 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:08.064151 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:08.072318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:08.073965 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:08.075113 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3b40c8c8-f6e0-4f6d-afb7-35192b41c67b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.163829 Jun 23 20:13:08.092374 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 369/722] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:07 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:08.440092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-638c068f-582c-49e0-819c-3364028f9b9e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:08.440701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-638c068f-582c-49e0-819c-3364028f9b9e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:08.447092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-638c068f-582c-49e0-819c-3364028f9b9e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:08.447536 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-638c068f-582c-49e0-819c-3364028f9b9e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:08.448315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-638c068f-582c-49e0-819c-3364028f9b9e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:08.448884 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-638c068f-582c-49e0-819c-3364028f9b9e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:08.473339 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-638c068f-582c-49e0-819c-3364028f9b9e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/ips" status: 200 len: 150 microversion: 2.1 time: 0.037892 Jun 23 20:13:08.477371 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 354/723] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:13:08 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:09.097543 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:09.098312 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:09.112689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:09.112689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:09.112689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:09.112689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:09.261121 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:09.273331 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:09.275882 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:09.276249 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e0ec760f-670d-485a-9721-6cd6f31ccd3b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.186692 Jun 23 20:13:09.276928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 370/724] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:09 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:10.125433 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1ae7c16a-6e1b-4c36-b9eb-e4543c9f7f0b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8defd8d4-1ec2-4dcd-a8ab-472b49d1c901"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:10.127172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1ae7c16a-6e1b-4c36-b9eb-e4543c9f7f0b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:10.135970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1ae7c16a-6e1b-4c36-b9eb-e4543c9f7f0b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:10.136458 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1ae7c16a-6e1b-4c36-b9eb-e4543c9f7f0b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:10.137242 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1ae7c16a-6e1b-4c36-b9eb-e4543c9f7f0b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:10.137678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1ae7c16a-6e1b-4c36-b9eb-e4543c9f7f0b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:10.295110 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:10.295744 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:10.302594 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:10.303113 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:10.304073 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:10.304527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:10.440710 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:10.448947 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:10.450467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:10.451671 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f7c3491a-cf6b-4d7d-b538-7d9e82cd27ce tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.160572 Jun 23 20:13:10.452333 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 371/725] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:10 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:13:11.473092 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:11.474185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:11.480669 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:11.481114 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:11.481877 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:11.482307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:11.626891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:11.635913 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:11.637598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:11.638862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d8608492-29fb-45a2-a044-080c73eed842 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.171794 Jun 23 20:13:11.639452 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 372/726] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:11 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:13:12.657332 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:12.657996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:12.664314 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:12.664858 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:12.665848 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:12.666468 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:12.807046 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:12.815866 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:12.818033 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:12.819333 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d9cc62e8-8aa4-46b2-94e4-3ef736b13acb tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.165829 Jun 23 20:13:12.819916 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 373/727] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:12 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:13:12.930225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-267528e6-cf0f-4dcc-8304-71b0e7433d60 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:12.930635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-267528e6-cf0f-4dcc-8304-71b0e7433d60 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:12.936763 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-267528e6-cf0f-4dcc-8304-71b0e7433d60 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:12.937212 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-267528e6-cf0f-4dcc-8304-71b0e7433d60 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:12.937979 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-267528e6-cf0f-4dcc-8304-71b0e7433d60 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:12.938415 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-267528e6-cf0f-4dcc-8304-71b0e7433d60 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:12.963452 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-267528e6-cf0f-4dcc-8304-71b0e7433d60 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/ips" status: 200 len: 146 microversion: 2.1 time: 0.037565 Jun 23 20:13:12.964035 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 374/728] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:13:12 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:13:13.843408 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:13.844186 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:13.851327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:13.851773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:13.852560 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:13.852994 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:13.984092 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:13.992196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:13.993724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:13.994866 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9f859fb0-432f-4616-a460-648556994d4b tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.155336 Jun 23 20:13:13.995649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 375/729] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:13 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:13:15.018626 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:15.019706 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:15.028585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:15.029255 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:15.030497 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:15.031133 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:15.178319 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:15.187832 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:15.189359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:15.190513 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-905d0f8a-e11c-46c2-8c0e-522a23ab12e9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.180521 Jun 23 20:13:15.191062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 376/730] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:15 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:16.209018 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:16.209774 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:16.215760 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:16.216203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:16.216986 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:16.217418 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:16.363770 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:16.376823 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:16.376823 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:16.381822 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b22913ca-0533-4450-8911-b94b5bb099c3 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.176855 Jun 23 20:13:16.393197 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 377/731] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:16 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:13:17.399850 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:17.400505 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:17.406582 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:17.410822 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:17.410822 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:17.410822 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:17.423164 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:17.839981 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:17.847675 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:17.849185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:17.850846 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-80fb7a30-ceb0-481b-a43d-6aed0165c0f2 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.455596 Jun 23 20:13:17.851375 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 378/732] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:17 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:13:18.166881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1ae7c16a-6e1b-4c36-b9eb-e4543c9f7f0b tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "POST /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.046713 Jun 23 20:13:18.167516 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 355/733] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:13:10 2022] POST /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments => generated 194 bytes in 8048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:18.542061 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2812ba4d-b5cd-40ea-a483-e8758c39c1d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0779c062-ce2f-43a2-91e5-7b03fbaea281"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:18.543367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2812ba4d-b5cd-40ea-a483-e8758c39c1d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:18.549630 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2812ba4d-b5cd-40ea-a483-e8758c39c1d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:18.549950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2812ba4d-b5cd-40ea-a483-e8758c39c1d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:18.550902 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2812ba4d-b5cd-40ea-a483-e8758c39c1d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:18.551421 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2812ba4d-b5cd-40ea-a483-e8758c39c1d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:18.872834 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:18.873465 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:18.880365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:18.881372 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:18.882174 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:18.882613 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:19.015946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:19.024499 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:19.026251 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:19.027414 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bac037fb-5fa3-40a5-81ff-d565202c3506 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.158962 Jun 23 20:13:19.027989 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 356/734] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:18 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:13:19.625434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2812ba4d-b5cd-40ea-a483-e8758c39c1d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.087829 Jun 23 20:13:19.626240 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 379/735] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:13:18 2022] POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/os-volume_attachments => generated 194 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:20.046157 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:20.046707 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:20.053094 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:20.053545 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:20.054303 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:20.054738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:20.180940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:20.188772 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:20.190264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:20.191403 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be576051-3ee5-4730-a6f9-88e587ee8691 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.149285 Jun 23 20:13:20.191953 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 357/736] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:20 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:21.211182 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:21.211866 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:21.218513 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:21.218955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:21.219696 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:21.220125 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:21.350801 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:21.358653 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:21.360147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:21.361325 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-cfc152ec-ce6b-4b32-8545-ea7ea5392bec tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.154886 Jun 23 20:13:21.361892 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 380/737] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:21 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:22.379258 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:22.379792 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:22.386800 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:22.387308 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:22.388071 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:22.388540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:22.517901 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:22.526474 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:22.527988 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:22.529874 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b453e04d-847e-4d7c-b092-db296bcb5cd9 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.154541 Jun 23 20:13:22.530584 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 358/738] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:22 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:22.643634 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-209c8a9b-1718-4c3e-a824-4073a016556e req-ebad29ab-90eb-4d38-9cb1-d02013b9625f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfc5144-0d0f-4d88-bfef-d92a270ca655", "name": "network-vif-plugged", "status": "completed", "tag": "048e62b5-3005-46cb-96bf-1c13423b57db"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:22.653092 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-209c8a9b-1718-4c3e-a824-4073a016556e req-ebad29ab-90eb-4d38-9cb1-d02013b9625f service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:22.653536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-209c8a9b-1718-4c3e-a824-4073a016556e req-ebad29ab-90eb-4d38-9cb1-d02013b9625f service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:22.664517 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-209c8a9b-1718-4c3e-a824-4073a016556e req-ebad29ab-90eb-4d38-9cb1-d02013b9625f service nova] Creating event network-vif-plugged:048e62b5-3005-46cb-96bf-1c13423b57db for instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 on hv-cinder-84727 Jun 23 20:13:22.669331 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-209c8a9b-1718-4c3e-a824-4073a016556e req-ebad29ab-90eb-4d38-9cb1-d02013b9625f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029759 Jun 23 20:13:22.669903 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 381/739] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:23.548072 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:23.548685 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:23.551156 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=32 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:23.555909 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:23.556405 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:23.557159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:23.557595 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:23.685373 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:23.693321 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:23.694825 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:23.695976 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a2188e92-4722-42d2-a66b-21fd3e0ef1a1 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.152073 Jun 23 20:13:23.696576 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 359/740] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:23 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:24.714261 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:24.714952 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:24.721129 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:24.721576 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:24.722327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:24.722792 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:24.851149 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:24.859229 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:24.860759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:24.861914 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8436a0a2-31fb-444a-b368-73257b6cd0a5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1731 microversion: 2.20 time: 0.152412 Jun 23 20:13:24.862594 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 382/741] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:24 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:25.880073 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:25.880702 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:25.887813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:25.888257 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:25.889045 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:25.889481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:26.024462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:26.032380 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:26.033866 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:26.034999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be211256-75b6-449d-9b12-23a201055e38 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1718 microversion: 2.20 time: 0.158817 Jun 23 20:13:26.035597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 360/742] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:25 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:13:26.926293 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-aa7537b5-9625-41d9-a0d1-bed0b7513d34 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:26.926761 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-aa7537b5-9625-41d9-a0d1-bed0b7513d34 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:26.933176 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-aa7537b5-9625-41d9-a0d1-bed0b7513d34 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:26.933628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-aa7537b5-9625-41d9-a0d1-bed0b7513d34 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:26.934401 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-aa7537b5-9625-41d9-a0d1-bed0b7513d34 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:26.934826 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-aa7537b5-9625-41d9-a0d1-bed0b7513d34 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:27.015105 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-aa7537b5-9625-41d9-a0d1-bed0b7513d34 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lazy-loading 'services' on Instance uuid 3ce09a9c-e549-437f-bf4a-798772ff530a {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:13:27.184794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-aa7537b5-9625-41d9-a0d1-bed0b7513d34 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments/8defd8d4-1ec2-4dcd-a8ab-472b49d1c901" status: 202 len: 0 microversion: 2.1 time: 0.261707 Jun 23 20:13:27.185319 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 383/743] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:13:26 2022] DELETE /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments/8defd8d4-1ec2-4dcd-a8ab-472b49d1c901 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:13:27.193445 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-87613bf9-c52d-46d7-9913-7a209052fe17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:27.194672 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-87613bf9-c52d-46d7-9913-7a209052fe17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:27.201896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-87613bf9-c52d-46d7-9913-7a209052fe17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:27.202339 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-87613bf9-c52d-46d7-9913-7a209052fe17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:27.203092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-87613bf9-c52d-46d7-9913-7a209052fe17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:27.203550 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-87613bf9-c52d-46d7-9913-7a209052fe17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:27.233425 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-87613bf9-c52d-46d7-9913-7a209052fe17 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042392 Jun 23 20:13:27.233425 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 361/744] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:13:27 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:28.245482 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9db944c2-abc2-4954-9f9a-97561e154bb4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:28.246533 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9db944c2-abc2-4954-9f9a-97561e154bb4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:28.252930 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9db944c2-abc2-4954-9f9a-97561e154bb4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:28.253385 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9db944c2-abc2-4954-9f9a-97561e154bb4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:28.254152 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9db944c2-abc2-4954-9f9a-97561e154bb4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:28.254589 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9db944c2-abc2-4954-9f9a-97561e154bb4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:28.284014 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9db944c2-abc2-4954-9f9a-97561e154bb4 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 Jun 23 20:13:28.284805 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 384/745] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:13:28 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:29.295990 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9cc9d195-d143-4103-a5c0-1e779e5b98db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:29.296911 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9cc9d195-d143-4103-a5c0-1e779e5b98db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:29.303562 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9cc9d195-d143-4103-a5c0-1e779e5b98db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:29.304017 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9cc9d195-d143-4103-a5c0-1e779e5b98db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:29.304823 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9cc9d195-d143-4103-a5c0-1e779e5b98db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:29.305264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9cc9d195-d143-4103-a5c0-1e779e5b98db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:29.334595 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9cc9d195-d143-4103-a5c0-1e779e5b98db tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Jun 23 20:13:29.335072 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 362/746] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:13:29 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:30.346459 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-64c18998-de14-4016-98f0-4db129bc334a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:30.347365 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-64c18998-de14-4016-98f0-4db129bc334a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:30.353949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-64c18998-de14-4016-98f0-4db129bc334a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:30.354399 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-64c18998-de14-4016-98f0-4db129bc334a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:30.355147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-64c18998-de14-4016-98f0-4db129bc334a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:30.355580 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-64c18998-de14-4016-98f0-4db129bc334a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:30.383842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-64c18998-de14-4016-98f0-4db129bc334a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041253 Jun 23 20:13:30.384366 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 385/747] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:13:30 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:31.396000 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b1489c77-a6dc-48f3-b1d2-afe31b99454e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:31.396942 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b1489c77-a6dc-48f3-b1d2-afe31b99454e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:31.404233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1489c77-a6dc-48f3-b1d2-afe31b99454e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:31.404701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1489c77-a6dc-48f3-b1d2-afe31b99454e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:31.405448 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1489c77-a6dc-48f3-b1d2-afe31b99454e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:31.405886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b1489c77-a6dc-48f3-b1d2-afe31b99454e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:31.435327 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b1489c77-a6dc-48f3-b1d2-afe31b99454e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043285 Jun 23 20:13:31.435856 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 363/748] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:13:31 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:32.445867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-62a51570-4a1e-4d83-9864-dee5f946ada6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:32.446691 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-62a51570-4a1e-4d83-9864-dee5f946ada6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:32.453196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-62a51570-4a1e-4d83-9864-dee5f946ada6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:32.453641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-62a51570-4a1e-4d83-9864-dee5f946ada6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:32.454380 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-62a51570-4a1e-4d83-9864-dee5f946ada6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:32.454806 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-62a51570-4a1e-4d83-9864-dee5f946ada6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:32.483833 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-62a51570-4a1e-4d83-9864-dee5f946ada6 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041919 Jun 23 20:13:32.484394 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 386/749] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:13:32 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:33.437630 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c16ba328-1b74-4259-8e99-5222791ff009 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:33.444322 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c16ba328-1b74-4259-8e99-5222791ff009 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:33.444769 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c16ba328-1b74-4259-8e99-5222791ff009 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:33.496340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5b8b08dc-7cfc-4784-8f32-47c28a59f835 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:33.497909 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5b8b08dc-7cfc-4784-8f32-47c28a59f835 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:33.506343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5b8b08dc-7cfc-4784-8f32-47c28a59f835 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:33.506829 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5b8b08dc-7cfc-4784-8f32-47c28a59f835 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:33.507600 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5b8b08dc-7cfc-4784-8f32-47c28a59f835 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:33.508036 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5b8b08dc-7cfc-4784-8f32-47c28a59f835 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:33.509721 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c16ba328-1b74-4259-8e99-5222791ff009 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Going to try to stop instance {{(pid=118345) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 20:13:33.537914 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5b8b08dc-7cfc-4784-8f32-47c28a59f835 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046643 Jun 23 20:13:33.538481 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 387/750] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:13:33 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:13:33.722238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c16ba328-1b74-4259-8e99-5222791ff009 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/action" status: 202 len: 0 microversion: 2.1 time: 0.288523 Jun 23 20:13:33.728475 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 364/751] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:13:33 2022] POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:13:33.731631 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b663a6b6-214d-4495-bcc9-d69f61ae1867 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:33.732229 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b663a6b6-214d-4495-bcc9-d69f61ae1867 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:33.739181 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b663a6b6-214d-4495-bcc9-d69f61ae1867 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:33.739625 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b663a6b6-214d-4495-bcc9-d69f61ae1867 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:33.740480 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b663a6b6-214d-4495-bcc9-d69f61ae1867 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:33.740910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b663a6b6-214d-4495-bcc9-d69f61ae1867 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:33.872460 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b663a6b6-214d-4495-bcc9-d69f61ae1867 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:33.880646 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b663a6b6-214d-4495-bcc9-d69f61ae1867 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.153502 Jun 23 20:13:33.881245 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 388/752] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:33 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:34.550129 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-dbf60040-53c1-402c-907e-ad74a428119c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:34.551143 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-dbf60040-53c1-402c-907e-ad74a428119c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:34.558242 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dbf60040-53c1-402c-907e-ad74a428119c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:34.558698 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dbf60040-53c1-402c-907e-ad74a428119c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:34.559461 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dbf60040-53c1-402c-907e-ad74a428119c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:34.559898 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-dbf60040-53c1-402c-907e-ad74a428119c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:34.589937 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-dbf60040-53c1-402c-907e-ad74a428119c tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044065 Jun 23 20:13:34.590482 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 365/753] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:13:34 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 20:13:34.651422 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4b563a5f-e060-4f81-a2f9-752cb77abac5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:34.652025 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4b563a5f-e060-4f81-a2f9-752cb77abac5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:34.654364 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=46 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:34.665216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4b563a5f-e060-4f81-a2f9-752cb77abac5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:34.665216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4b563a5f-e060-4f81-a2f9-752cb77abac5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:34.665216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4b563a5f-e060-4f81-a2f9-752cb77abac5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:34.665216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4b563a5f-e060-4f81-a2f9-752cb77abac5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:34.691381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4b563a5f-e060-4f81-a2f9-752cb77abac5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:13:34.897694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-229de90c-68c3-4934-9ab9-ae423f1193a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:34.898299 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-229de90c-68c3-4934-9ab9-ae423f1193a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:34.904202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-229de90c-68c3-4934-9ab9-ae423f1193a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:34.904680 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-229de90c-68c3-4934-9ab9-ae423f1193a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:34.905433 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-229de90c-68c3-4934-9ab9-ae423f1193a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:34.905867 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-229de90c-68c3-4934-9ab9-ae423f1193a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:34.998782 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4b563a5f-e060-4f81-a2f9-752cb77abac5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 204 len: 0 microversion: 2.1 time: 0.350922 Jun 23 20:13:34.999621 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 389/754] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:13:34 2022] DELETE /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:13:35.013945 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b417f26d-b322-464c-926e-c89846e8b6c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:35.014768 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b417f26d-b322-464c-926e-c89846e8b6c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:35.020704 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b417f26d-b322-464c-926e-c89846e8b6c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:35.021151 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b417f26d-b322-464c-926e-c89846e8b6c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:35.021898 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b417f26d-b322-464c-926e-c89846e8b6c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:35.022327 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b417f26d-b322-464c-926e-c89846e8b6c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:35.042842 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-229de90c-68c3-4934-9ab9-ae423f1193a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:35.048549 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-229de90c-68c3-4934-9ab9-ae423f1193a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.154567 Jun 23 20:13:35.049116 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 366/755] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:34 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:35.151654 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b417f26d-b322-464c-926e-c89846e8b6c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:35.159037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b417f26d-b322-464c-926e-c89846e8b6c5 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1682 microversion: 2.1 time: 0.149274 Jun 23 20:13:35.159597 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 390/756] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:35 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:36.066299 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-377ac033-2f2d-4f01-b585-340f6f731486 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:36.066904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-377ac033-2f2d-4f01-b585-340f6f731486 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:36.073345 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-377ac033-2f2d-4f01-b585-340f6f731486 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:36.074443 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-377ac033-2f2d-4f01-b585-340f6f731486 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:36.075202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-377ac033-2f2d-4f01-b585-340f6f731486 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:36.075639 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-377ac033-2f2d-4f01-b585-340f6f731486 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:36.182691 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3750a7c0-9cc7-4c8d-af06-d8efa740699a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:36.183908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3750a7c0-9cc7-4c8d-af06-d8efa740699a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:36.190688 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3750a7c0-9cc7-4c8d-af06-d8efa740699a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:36.191218 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3750a7c0-9cc7-4c8d-af06-d8efa740699a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:36.192045 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3750a7c0-9cc7-4c8d-af06-d8efa740699a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:36.192599 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3750a7c0-9cc7-4c8d-af06-d8efa740699a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:36.211665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-377ac033-2f2d-4f01-b585-340f6f731486 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:36.219648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-377ac033-2f2d-4f01-b585-340f6f731486 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.157280 Jun 23 20:13:36.220210 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 367/757] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:36 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:36.320713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3750a7c0-9cc7-4c8d-af06-d8efa740699a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:36.328789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3750a7c0-9cc7-4c8d-af06-d8efa740699a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1682 microversion: 2.1 time: 0.150002 Jun 23 20:13:36.329358 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 391/758] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:36 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:36.768995 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-611697125", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-841892012", "security_groups": [{"name": "tempest-secgroup-smoke-1008165961"}], "block_device_mapping_v2": [{"uuid": "29fc9914-0c40-43ea-b189-1c4cc508eafa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0be33fe-ef21-4463-bb71-a01e82ba375e"}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:36.878663 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] validate_networks() for [('e0be33fe-ef21-4463-bb71-a01e82ba375e', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:13:37.236804 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0870d446-a87e-42e7-81e0-4abd7f1d0706 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:37.237501 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0870d446-a87e-42e7-81e0-4abd7f1d0706 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:37.244372 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0870d446-a87e-42e7-81e0-4abd7f1d0706 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:37.244898 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0870d446-a87e-42e7-81e0-4abd7f1d0706 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:37.245673 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0870d446-a87e-42e7-81e0-4abd7f1d0706 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:37.246112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0870d446-a87e-42e7-81e0-4abd7f1d0706 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:37.248837 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:37.334878 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:13:37.335404 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:13:37.335876 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:13:37.336439 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:13:37.336918 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:13:37.348225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:37.349578 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:37.349578 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:37.350092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:37.356938 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:37.367308 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Getting quotas for project edb569a8b39a437ea8be940df098268c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:13:37.371228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Getting quotas for user eafea4329d6243459dd3a6add1e91a2e and project edb569a8b39a437ea8be940df098268c. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:13:37.429160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:13:37.431532 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29fc9914-0c40-43ea-b189-1c4cc508eafa',volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:13:37.495602 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0870d446-a87e-42e7-81e0-4abd7f1d0706 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:37.503993 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0870d446-a87e-42e7-81e0-4abd7f1d0706 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.271056 Jun 23 20:13:37.504616 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 392/759] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:37 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:37.509927 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b8beecc5-3f7d-4580-bda0-2737fb8691ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:37.510537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b8beecc5-3f7d-4580-bda0-2737fb8691ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:37.518726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8beecc5-3f7d-4580-bda0-2737fb8691ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:37.519282 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8beecc5-3f7d-4580-bda0-2737fb8691ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:37.520528 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8beecc5-3f7d-4580-bda0-2737fb8691ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:37.520528 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b8beecc5-3f7d-4580-bda0-2737fb8691ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:37.755891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b8beecc5-3f7d-4580-bda0-2737fb8691ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:37.764890 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b8beecc5-3f7d-4580-bda0-2737fb8691ae tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1682 microversion: 2.1 time: 0.259260 Jun 23 20:13:37.765732 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 393/760] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:37 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1682 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:37.866429 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-92eefc3a-6f25-476a-afe3-b0b0a3edafb8 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.101440 Jun 23 20:13:37.867297 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 368/761] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:13:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:13:37.877981 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-396e9a9d-19f9-49b0-b86c-8736fb158a80 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:37.881005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-396e9a9d-19f9-49b0-b86c-8736fb158a80 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:37.938939 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-396e9a9d-19f9-49b0-b86c-8736fb158a80 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:37.945453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-396e9a9d-19f9-49b0-b86c-8736fb158a80 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1093 microversion: 2.1 time: 0.071797 Jun 23 20:13:37.946017 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 394/762] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:37 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:38.342956 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-374e52df-188c-4489-aa2d-692a76e6410f req-aa5daaf9-71a4-447f-9432-774b8e4ed429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce09a9c-e549-437f-bf4a-798772ff530a", "name": "network-vif-deleted", "tag": "e2d0b98f-658e-4a67-b7b7-f295d7433972"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:38.354699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-374e52df-188c-4489-aa2d-692a76e6410f req-aa5daaf9-71a4-447f-9432-774b8e4ed429 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:38.355926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-374e52df-188c-4489-aa2d-692a76e6410f req-aa5daaf9-71a4-447f-9432-774b8e4ed429 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:38.368179 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-374e52df-188c-4489-aa2d-692a76e6410f req-aa5daaf9-71a4-447f-9432-774b8e4ed429 service nova] Creating event network-vif-deleted:e2d0b98f-658e-4a67-b7b7-f295d7433972 for instance 3ce09a9c-e549-437f-bf4a-798772ff530a on hv-cinder-84727 Jun 23 20:13:38.374422 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-374e52df-188c-4489-aa2d-692a76e6410f req-aa5daaf9-71a4-447f-9432-774b8e4ed429 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098758 Jun 23 20:13:38.375470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 369/763] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:38.521777 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7b9d6407-965e-4581-848a-3000bb35a308 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:38.522386 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7b9d6407-965e-4581-848a-3000bb35a308 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:38.530215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7b9d6407-965e-4581-848a-3000bb35a308 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:38.530749 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7b9d6407-965e-4581-848a-3000bb35a308 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:38.531511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7b9d6407-965e-4581-848a-3000bb35a308 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:38.532134 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7b9d6407-965e-4581-848a-3000bb35a308 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:38.676088 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7b9d6407-965e-4581-848a-3000bb35a308 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:38.684462 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7b9d6407-965e-4581-848a-3000bb35a308 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.166603 Jun 23 20:13:38.685032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 395/764] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:38 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:38.783939 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:38.785434 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:38.791000 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:38.791447 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:38.792236 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:38.792737 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:38.824159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:38.824628 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:38.825080 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lazy-loading 'fault' on Instance uuid 3ce09a9c-e549-437f-bf4a-798772ff530a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:13:38.879875 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a5b19c8c0d44e1f93bb1dea72884cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd810755b80346ae9219a2d0c61a8a06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:38.887990 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-eaa5edf0-db81-435d-bc48-924d05bc1938 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 200 len: 1331 microversion: 2.1 time: 0.109136 Jun 23 20:13:38.888581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 370/765] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:38 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:38.962604 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6968d4a3-0054-4282-bdd6-cb17c2934860 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:38.963200 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6968d4a3-0054-4282-bdd6-cb17c2934860 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:38.969746 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6968d4a3-0054-4282-bdd6-cb17c2934860 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:38.970180 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6968d4a3-0054-4282-bdd6-cb17c2934860 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:38.970921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6968d4a3-0054-4282-bdd6-cb17c2934860 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:38.971346 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6968d4a3-0054-4282-bdd6-cb17c2934860 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:39.030871 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-6968d4a3-0054-4282-bdd6-cb17c2934860 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:39.038310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6968d4a3-0054-4282-bdd6-cb17c2934860 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1143 microversion: 2.1 time: 0.079592 Jun 23 20:13:39.038870 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 396/766] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:38 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:39.700667 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-991247b0-9210-44a6-aa4a-74bc0785d71b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:39.701275 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-991247b0-9210-44a6-aa4a-74bc0785d71b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:39.707967 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-991247b0-9210-44a6-aa4a-74bc0785d71b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:39.708447 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-991247b0-9210-44a6-aa4a-74bc0785d71b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:39.709196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-991247b0-9210-44a6-aa4a-74bc0785d71b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:39.709632 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-991247b0-9210-44a6-aa4a-74bc0785d71b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:39.838678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-991247b0-9210-44a6-aa4a-74bc0785d71b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:39.847316 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-991247b0-9210-44a6-aa4a-74bc0785d71b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.150687 Jun 23 20:13:39.847874 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 371/767] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:39 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:39.904960 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:39.905578 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:39.912205 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:39.912687 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:39.913451 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:39.913890 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:39.927820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a HTTP/1.1 Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:13:39.931969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:39.933405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '3ce09a9c-e549-437f-bf4a-798772ff530a'} Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:13:39.934161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:39.935398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:39.936915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:13:39.936915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bd97ec92-713a-4139-a7dc-b48035d2d54f tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 404 len: 111 microversion: 2.1 time: 0.030716 Jun 23 20:13:39.936915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 397/768] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:39 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:13:39.939801 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bbb23bdf-a3c7-4622-980d-cd7f6e79f38a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '.version_select at 0x7f90d9d3b940>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:40.038996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bbb23bdf-a3c7-4622-980d-cd7f6e79f38a tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1284338739" status: 202 len: 0 microversion: 2.1 time: 0.102889 Jun 23 20:13:40.039487 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 372/769] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jun 23 20:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1284338739 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:13:40.054713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-401f4f17-cd3a-4dd4-8cc4-3ec57b03ab9a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:40.055314 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-401f4f17-cd3a-4dd4-8cc4-3ec57b03ab9a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:40.061355 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-401f4f17-cd3a-4dd4-8cc4-3ec57b03ab9a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:40.063808 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-401f4f17-cd3a-4dd4-8cc4-3ec57b03ab9a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:40.063808 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-401f4f17-cd3a-4dd4-8cc4-3ec57b03ab9a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:40.063808 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-401f4f17-cd3a-4dd4-8cc4-3ec57b03ab9a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:40.123726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-401f4f17-cd3a-4dd4-8cc4-3ec57b03ab9a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:40.131471 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-401f4f17-cd3a-4dd4-8cc4-3ec57b03ab9a tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1191 microversion: 2.1 time: 0.080283 Jun 23 20:13:40.140578 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 398/770] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:40 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:40.865907 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-240abfa2-ff43-43ed-92b4-cfefcfbe261f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:40.871602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-240abfa2-ff43-43ed-92b4-cfefcfbe261f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:40.873153 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-240abfa2-ff43-43ed-92b4-cfefcfbe261f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:40.873603 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-240abfa2-ff43-43ed-92b4-cfefcfbe261f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:40.874370 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-240abfa2-ff43-43ed-92b4-cfefcfbe261f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:40.874803 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-240abfa2-ff43-43ed-92b4-cfefcfbe261f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:41.147959 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-44de614c-27d0-417a-84e6-8581c3d99a55 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:41.148590 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-44de614c-27d0-417a-84e6-8581c3d99a55 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:41.155302 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-44de614c-27d0-417a-84e6-8581c3d99a55 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:41.155751 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-44de614c-27d0-417a-84e6-8581c3d99a55 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:41.155862 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-240abfa2-ff43-43ed-92b4-cfefcfbe261f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:41.156547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-44de614c-27d0-417a-84e6-8581c3d99a55 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:41.156984 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-44de614c-27d0-417a-84e6-8581c3d99a55 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:41.164273 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-240abfa2-ff43-43ed-92b4-cfefcfbe261f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.302687 Jun 23 20:13:41.165199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 373/771] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:40 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:41.242524 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-44de614c-27d0-417a-84e6-8581c3d99a55 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:41.252006 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-44de614c-27d0-417a-84e6-8581c3d99a55 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1209 microversion: 2.1 time: 0.107962 Jun 23 20:13:41.252507 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 399/772] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:41 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:42.182366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7d103261-92b6-43f6-a741-3ee6ec47d0af tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:42.183734 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7d103261-92b6-43f6-a741-3ee6ec47d0af tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:42.190326 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7d103261-92b6-43f6-a741-3ee6ec47d0af tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:42.190843 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7d103261-92b6-43f6-a741-3ee6ec47d0af tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:42.191666 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7d103261-92b6-43f6-a741-3ee6ec47d0af tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:42.192166 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7d103261-92b6-43f6-a741-3ee6ec47d0af tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:42.268267 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9cca8f87-c17e-433b-9662-e0144abab0d6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:42.268993 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9cca8f87-c17e-433b-9662-e0144abab0d6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:42.275640 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9cca8f87-c17e-433b-9662-e0144abab0d6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:42.276163 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9cca8f87-c17e-433b-9662-e0144abab0d6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:42.277521 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9cca8f87-c17e-433b-9662-e0144abab0d6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:42.278027 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9cca8f87-c17e-433b-9662-e0144abab0d6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:42.454771 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7d103261-92b6-43f6-a741-3ee6ec47d0af tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:42.463113 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7d103261-92b6-43f6-a741-3ee6ec47d0af tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.284650 Jun 23 20:13:42.463687 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 374/773] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:42 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:42.513426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9cca8f87-c17e-433b-9662-e0144abab0d6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:42.521347 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9cca8f87-c17e-433b-9662-e0144abab0d6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.256851 Jun 23 20:13:42.522082 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 400/774] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:42 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:42.958326 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-d96c34d3-50b9-490d-857a-0c3802cabab8 req-836eb7ac-625b-48ab-aa96-03015dba5559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a12f15d-0c87-4413-a893-463700ea1e11", "tag": "a261f993-dd66-47dc-9b31-a51d223f5302"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:42.969807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-d96c34d3-50b9-490d-857a-0c3802cabab8 req-836eb7ac-625b-48ab-aa96-03015dba5559 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:42.973721 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-d96c34d3-50b9-490d-857a-0c3802cabab8 req-836eb7ac-625b-48ab-aa96-03015dba5559 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:42.983660 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-d96c34d3-50b9-490d-857a-0c3802cabab8 req-836eb7ac-625b-48ab-aa96-03015dba5559 service nova] Creating event network-changed:a261f993-dd66-47dc-9b31-a51d223f5302 for instance 6a12f15d-0c87-4413-a893-463700ea1e11 on hv-cinder-84727 Jun 23 20:13:42.988796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-d96c34d3-50b9-490d-857a-0c3802cabab8 req-836eb7ac-625b-48ab-aa96-03015dba5559 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034284 Jun 23 20:13:42.989993 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 375/775] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:42.990159 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:42.990726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:42.998592 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:42.999040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:42.999807 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:43.000237 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:43.014809 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: DELETE /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a HTTP/1.1 Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:13:43.017570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.019147 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '3ce09a9c-e549-437f-bf4a-798772ff530a'} Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:13:43.020016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.021538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.024286 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:13:43.025204 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f1223892-d288-461c-8078-e793d5858121 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 404 len: 111 microversion: 2.1 time: 0.041262 Jun 23 20:13:43.025916 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 401/776] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:13:42 2022] DELETE /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:13:43.034469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:43.035169 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: 3ce09a9c-e549-437f-bf4a-798772ff530a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:43.041939 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:43.042423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:43.043224 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:43.043662 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:43.058455 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a HTTP/1.1 Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:13:43.060481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.062068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '3ce09a9c-e549-437f-bf4a-798772ff530a'} Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:13:43.064948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. Jun 23 20:13:43.066486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:43.067751 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance 3ce09a9c-e549-437f-bf4a-798772ff530a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:13:43.067751 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cbcb146e-449f-4e6e-b7e3-08fc1bc3336e tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a" status: 404 len: 111 microversion: 2.1 time: 0.031686 Jun 23 20:13:43.067751 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 376/777] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:43 2022] GET /compute/v2.1/servers/3ce09a9c-e549-437f-bf4a-798772ff530a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:13:43.480936 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e0a97448-4ee7-431e-8766-6d4a27ba5eab tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:43.481569 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e0a97448-4ee7-431e-8766-6d4a27ba5eab tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:43.488674 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0a97448-4ee7-431e-8766-6d4a27ba5eab tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:43.489155 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0a97448-4ee7-431e-8766-6d4a27ba5eab tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:43.489931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0a97448-4ee7-431e-8766-6d4a27ba5eab tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:43.490390 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0a97448-4ee7-431e-8766-6d4a27ba5eab tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:43.540217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-61ec8a3b-55da-443e-b326-e2f821e165fb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:43.541461 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-61ec8a3b-55da-443e-b326-e2f821e165fb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:43.549033 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-61ec8a3b-55da-443e-b326-e2f821e165fb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:43.549481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-61ec8a3b-55da-443e-b326-e2f821e165fb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:43.550397 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-61ec8a3b-55da-443e-b326-e2f821e165fb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:43.550834 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-61ec8a3b-55da-443e-b326-e2f821e165fb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:43.774404 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e0a97448-4ee7-431e-8766-6d4a27ba5eab tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:43.782842 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e0a97448-4ee7-431e-8766-6d4a27ba5eab tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.306399 Jun 23 20:13:43.783410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 402/778] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:43 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:43.825341 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-61ec8a3b-55da-443e-b326-e2f821e165fb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:43.833278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-61ec8a3b-55da-443e-b326-e2f821e165fb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.296858 Jun 23 20:13:43.833832 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 377/779] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:43 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:44.327208 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:44.327699 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:44.333892 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.334333 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.335079 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.335503 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.349917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: DELETE /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da HTTP/1.1 Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:13:44.351409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.353011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'a0dadba6-4a1e-4c0d-8342-b999e026e0da'} Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:13:44.353917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.355474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.356875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:13:44.356875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-052bfcb2-2a46-4a6f-822c-19146a2e0167 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 404 len: 111 microversion: 2.1 time: 0.030036 Jun 23 20:13:44.356875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 403/780] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:13:44 2022] DELETE /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:13:44.361123 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:44.361738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a0dadba6-4a1e-4c0d-8342-b999e026e0da] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:44.367738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.368184 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.368975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.369416 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.383003 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da HTTP/1.1 Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:13:44.384657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.386838 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'a0dadba6-4a1e-4c0d-8342-b999e026e0da'} Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:13:44.387626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. Jun 23 20:13:44.388871 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.389926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance a0dadba6-4a1e-4c0d-8342-b999e026e0da could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:13:44.389926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-01c4a8fd-3716-4d7a-9f11-66e93bbd90eb tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da" status: 404 len: 111 microversion: 2.1 time: 0.028756 Jun 23 20:13:44.389926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 378/781] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:44 2022] GET /compute/v2.1/servers/a0dadba6-4a1e-4c0d-8342-b999e026e0da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:13:44.394928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:44.395418 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:44.401323 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.401788 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.402531 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.402959 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.416087 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: DELETE /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 HTTP/1.1 Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:13:44.417747 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.419294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'a4e635b7-eb5c-48a2-9806-5ac7d9f3c809'} Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:13:44.420166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.421583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.422920 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:13:44.422920 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8dab190a-d13c-4b2b-ada5-126c0d5db6bc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 404 len: 111 microversion: 2.1 time: 0.027916 Jun 23 20:13:44.422920 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 404/782] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:13:44 2022] DELETE /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:13:44.427093 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:44.427694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: a4e635b7-eb5c-48a2-9806-5ac7d9f3c809] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:44.434303 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.434849 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.435614 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.436054 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.449815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 HTTP/1.1 Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:13:44.451315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.452859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'a4e635b7-eb5c-48a2-9806-5ac7d9f3c809'} Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:13:44.453759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. Jun 23 20:13:44.455142 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:44.457085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:13:44.457085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-904b6597-5cd0-4874-8c4f-d6853b9aaf97 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809" status: 404 len: 111 microversion: 2.1 time: 0.029290 Jun 23 20:13:44.457085 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 379/783] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:44 2022] GET /compute/v2.1/servers/a4e635b7-eb5c-48a2-9806-5ac7d9f3c809 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:13:44.801335 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e0e8151b-f710-4371-8019-08e683e86c63 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:44.802369 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e0e8151b-f710-4371-8019-08e683e86c63 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:44.809896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0e8151b-f710-4371-8019-08e683e86c63 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.810337 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0e8151b-f710-4371-8019-08e683e86c63 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.811344 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0e8151b-f710-4371-8019-08e683e86c63 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.811776 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0e8151b-f710-4371-8019-08e683e86c63 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.850339 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3cff9be3-1cf1-42e5-ae99-8e4cb9b12509 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:44.850945 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3cff9be3-1cf1-42e5-ae99-8e4cb9b12509 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:44.858041 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3cff9be3-1cf1-42e5-ae99-8e4cb9b12509 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.858484 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3cff9be3-1cf1-42e5-ae99-8e4cb9b12509 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.859250 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3cff9be3-1cf1-42e5-ae99-8e4cb9b12509 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:44.859677 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3cff9be3-1cf1-42e5-ae99-8e4cb9b12509 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:44.994698 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e0e8151b-f710-4371-8019-08e683e86c63 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:45.003475 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e0e8151b-f710-4371-8019-08e683e86c63 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.206927 Jun 23 20:13:45.004035 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 405/784] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:44 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:45.024678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3cff9be3-1cf1-42e5-ae99-8e4cb9b12509 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:45.032542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3cff9be3-1cf1-42e5-ae99-8e4cb9b12509 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.185990 Jun 23 20:13:45.033088 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 380/785] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:44 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:45.812346 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:45.814351 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:45.819314 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:45.819756 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:45.820746 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:45.821181 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:45.835102 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: DELETE /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 HTTP/1.1 Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:13:45.836655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.839016 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'c507d545-f924-49b1-91db-92efe489eed7'} Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:13:45.839970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.841406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.843534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:13:45.843534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-96407223-6933-42e8-995c-d336d9faaf03 tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 404 len: 111 microversion: 2.1 time: 0.030124 Jun 23 20:13:45.843534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 406/786] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:13:45 2022] DELETE /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:13:45.846388 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:45.847019 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] [instance: c507d545-f924-49b1-91db-92efe489eed7] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:45.853028 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:45.853576 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:45.854201 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:45.854635 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:45.867833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] HTTP exception thrown: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Request method failure captured: Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 HTTP/1.1 Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMfxPpJtaXC9OkNt6SkXwCH1bE5BSBSjB8YtXf1HYHYpiLDGuJws6i6gMPzIpKXi69NoeoETxrTjM2_1uYPr6_4kHj5LgazqW7EtTCf15fALGdyannTHi4wJv2N4_VQ4aD4pTAy8mXbP7OubYEZ2_qmh5qNLiymJNdvEdU6IR0U4NWc Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:13:45.869348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bd810755b80346ae9219a2d0c61a8a06", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bd810755b80346ae9219a2d0c61a8a06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bd810755b80346ae9219a2d0c61a8a06"}]}] Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: bd810755b80346ae9219a2d0c61a8a06 Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2029214835 Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 8a5b19c8c0d44e1f93bb1dea72884cc3 Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeNegativeTest-2029214835-project Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.871396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'c507d545-f924-49b1-91db-92efe489eed7'} Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:13:45.872430 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. Jun 23 20:13:45.873629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:13:45.874774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] Returning 404 to user: Instance c507d545-f924-49b1-91db-92efe489eed7 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:13:45.874774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-34b74f57-6578-4821-bcdb-3100715a19cc tempest-AttachVolumeNegativeTest-2029214835 tempest-AttachVolumeNegativeTest-2029214835-project] 10.222.0.44 "GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7" status: 404 len: 111 microversion: 2.1 time: 0.028610 Jun 23 20:13:45.874774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 381/787] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:45 2022] GET /compute/v2.1/servers/c507d545-f924-49b1-91db-92efe489eed7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:13:46.020325 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e2c88c18-f08c-49ad-89b3-e2968a501fc4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:46.021297 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e2c88c18-f08c-49ad-89b3-e2968a501fc4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:46.027380 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e2c88c18-f08c-49ad-89b3-e2968a501fc4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:46.027828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e2c88c18-f08c-49ad-89b3-e2968a501fc4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:46.028611 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e2c88c18-f08c-49ad-89b3-e2968a501fc4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:46.029045 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e2c88c18-f08c-49ad-89b3-e2968a501fc4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:46.052886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-abe9f965-88d2-4856-9721-bff7dede740e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:46.053437 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-abe9f965-88d2-4856-9721-bff7dede740e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:46.060163 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-abe9f965-88d2-4856-9721-bff7dede740e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:46.060642 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-abe9f965-88d2-4856-9721-bff7dede740e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:46.061393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-abe9f965-88d2-4856-9721-bff7dede740e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:46.061993 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-abe9f965-88d2-4856-9721-bff7dede740e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:46.211413 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e2c88c18-f08c-49ad-89b3-e2968a501fc4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:46.219491 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e2c88c18-f08c-49ad-89b3-e2968a501fc4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.203064 Jun 23 20:13:46.220044 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 407/788] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:46 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:46.243803 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-abe9f965-88d2-4856-9721-bff7dede740e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:46.251964 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-abe9f965-88d2-4856-9721-bff7dede740e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.203022 Jun 23 20:13:46.252567 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 382/789] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:46 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:47.236970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c47fc6de-d355-4c27-a709-6c4c5a3ad5a5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:47.237566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c47fc6de-d355-4c27-a709-6c4c5a3ad5a5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:47.244080 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c47fc6de-d355-4c27-a709-6c4c5a3ad5a5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:47.244556 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c47fc6de-d355-4c27-a709-6c4c5a3ad5a5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:47.245313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c47fc6de-d355-4c27-a709-6c4c5a3ad5a5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:47.245739 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c47fc6de-d355-4c27-a709-6c4c5a3ad5a5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:47.268444 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-07d6f4aa-f41e-4c62-ba8f-3c06c1dc032e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:47.269050 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-07d6f4aa-f41e-4c62-ba8f-3c06c1dc032e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:47.275384 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07d6f4aa-f41e-4c62-ba8f-3c06c1dc032e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:47.286503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07d6f4aa-f41e-4c62-ba8f-3c06c1dc032e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:47.288993 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07d6f4aa-f41e-4c62-ba8f-3c06c1dc032e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:47.289452 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-07d6f4aa-f41e-4c62-ba8f-3c06c1dc032e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:47.358836 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:47.379616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=6 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:47.446330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c47fc6de-d355-4c27-a709-6c4c5a3ad5a5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:47.457662 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c47fc6de-d355-4c27-a709-6c4c5a3ad5a5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.224371 Jun 23 20:13:47.458620 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 408/790] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:47 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:47.485565 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-07d6f4aa-f41e-4c62-ba8f-3c06c1dc032e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:47.499732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-07d6f4aa-f41e-4c62-ba8f-3c06c1dc032e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.234946 Jun 23 20:13:47.500757 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 383/791] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:47 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:48.475466 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6f4924e6-176b-45bc-9d21-38619ab3059f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:48.476237 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6f4924e6-176b-45bc-9d21-38619ab3059f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:48.478302 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:48.488553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6f4924e6-176b-45bc-9d21-38619ab3059f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:48.488553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6f4924e6-176b-45bc-9d21-38619ab3059f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:48.488553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6f4924e6-176b-45bc-9d21-38619ab3059f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:48.490032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6f4924e6-176b-45bc-9d21-38619ab3059f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:48.516638 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6c4e876a-0d10-4a56-8248-d3d96c7c4c32 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:48.517249 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6c4e876a-0d10-4a56-8248-d3d96c7c4c32 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:48.527294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c4e876a-0d10-4a56-8248-d3d96c7c4c32 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:48.528350 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c4e876a-0d10-4a56-8248-d3d96c7c4c32 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:48.529347 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c4e876a-0d10-4a56-8248-d3d96c7c4c32 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:48.529840 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6c4e876a-0d10-4a56-8248-d3d96c7c4c32 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:48.694223 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-6f4924e6-176b-45bc-9d21-38619ab3059f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:48.704535 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6f4924e6-176b-45bc-9d21-38619ab3059f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1724 microversion: 2.1 time: 0.233143 Jun 23 20:13:48.705116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 409/792] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:48 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:48.730703 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6c4e876a-0d10-4a56-8248-d3d96c7c4c32 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:48.738040 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6c4e876a-0d10-4a56-8248-d3d96c7c4c32 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.225833 Jun 23 20:13:48.738586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 384/793] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:48 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:49.722173 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3b384cdd-433c-4eb0-965d-4accb6f14e20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:49.723071 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3b384cdd-433c-4eb0-965d-4accb6f14e20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:49.731817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b384cdd-433c-4eb0-965d-4accb6f14e20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:49.732270 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b384cdd-433c-4eb0-965d-4accb6f14e20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:49.736259 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b384cdd-433c-4eb0-965d-4accb6f14e20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:49.736259 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b384cdd-433c-4eb0-965d-4accb6f14e20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:49.755228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a0c02694-871d-4506-990e-15043f30cabf tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:49.756554 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a0c02694-871d-4506-990e-15043f30cabf tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:49.763252 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0c02694-871d-4506-990e-15043f30cabf tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:49.763846 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0c02694-871d-4506-990e-15043f30cabf tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:49.766716 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0c02694-871d-4506-990e-15043f30cabf tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:49.766716 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0c02694-871d-4506-990e-15043f30cabf tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:49.939910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3b384cdd-433c-4eb0-965d-4accb6f14e20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:49.944573 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a0c02694-871d-4506-990e-15043f30cabf tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:49.947917 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3b384cdd-433c-4eb0-965d-4accb6f14e20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1701 microversion: 2.1 time: 0.229614 Jun 23 20:13:49.948722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 410/794] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:49 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1701 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:49.953601 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a0c02694-871d-4506-990e-15043f30cabf tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.202276 Jun 23 20:13:49.954250 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 385/795] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:49 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:13:49.964786 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-afea9bbc-9b84-4c8c-8282-8d6c21323522 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:49.971340 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afea9bbc-9b84-4c8c-8282-8d6c21323522 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:49.971924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-afea9bbc-9b84-4c8c-8282-8d6c21323522 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:50.030939 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-afea9bbc-9b84-4c8c-8282-8d6c21323522 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Going to try to start instance {{(pid=118346) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 20:13:50.212958 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-afea9bbc-9b84-4c8c-8282-8d6c21323522 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/action" status: 202 len: 0 microversion: 2.1 time: 0.251515 Jun 23 20:13:50.220973 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 411/796] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:13:49 2022] POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:13:50.229306 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-43561e55-2dd6-4372-a711-b00174efca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:50.230044 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-43561e55-2dd6-4372-a711-b00174efca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:50.242663 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43561e55-2dd6-4372-a711-b00174efca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:50.242874 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43561e55-2dd6-4372-a711-b00174efca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:50.243578 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43561e55-2dd6-4372-a711-b00174efca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:50.244019 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43561e55-2dd6-4372-a711-b00174efca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:50.390316 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-43561e55-2dd6-4372-a711-b00174efca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:50.399836 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-43561e55-2dd6-4372-a711-b00174efca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1710 microversion: 2.1 time: 0.179133 Jun 23 20:13:50.400622 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 386/797] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:50 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1710 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:50.972048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-92057e71-972e-44a3-9671-e520c7b3f241 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:50.972537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-92057e71-972e-44a3-9671-e520c7b3f241 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:50.979085 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-92057e71-972e-44a3-9671-e520c7b3f241 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:50.981304 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-92057e71-972e-44a3-9671-e520c7b3f241 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:50.981304 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-92057e71-972e-44a3-9671-e520c7b3f241 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:50.981500 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-92057e71-972e-44a3-9671-e520c7b3f241 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:50.985590 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:51.115534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-92057e71-972e-44a3-9671-e520c7b3f241 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:51.122974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-92057e71-972e-44a3-9671-e520c7b3f241 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.156229 Jun 23 20:13:51.123561 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 412/798] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:50 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:51.416401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-925327a4-8806-4f82-a0e0-ef4c18b78de3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:51.417157 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-925327a4-8806-4f82-a0e0-ef4c18b78de3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:51.423531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-925327a4-8806-4f82-a0e0-ef4c18b78de3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:51.423978 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-925327a4-8806-4f82-a0e0-ef4c18b78de3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:51.424766 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-925327a4-8806-4f82-a0e0-ef4c18b78de3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:51.425203 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-925327a4-8806-4f82-a0e0-ef4c18b78de3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:51.561484 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-925327a4-8806-4f82-a0e0-ef4c18b78de3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:51.569451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-925327a4-8806-4f82-a0e0-ef4c18b78de3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1710 microversion: 2.1 time: 0.156992 Jun 23 20:13:51.570011 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 387/799] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:51 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:52.140259 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7dc65495-c71f-48cb-9f2d-8f8d9fb4e387 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:52.140887 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7dc65495-c71f-48cb-9f2d-8f8d9fb4e387 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:52.147635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7dc65495-c71f-48cb-9f2d-8f8d9fb4e387 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:52.148095 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7dc65495-c71f-48cb-9f2d-8f8d9fb4e387 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:52.148863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7dc65495-c71f-48cb-9f2d-8f8d9fb4e387 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:52.149297 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7dc65495-c71f-48cb-9f2d-8f8d9fb4e387 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:52.290607 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7dc65495-c71f-48cb-9f2d-8f8d9fb4e387 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:52.298742 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7dc65495-c71f-48cb-9f2d-8f8d9fb4e387 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.163164 Jun 23 20:13:52.307908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 413/800] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:52 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:52.587493 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3662f957-7643-4fe6-af44-45e9575d631b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:52.588094 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3662f957-7643-4fe6-af44-45e9575d631b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:52.595721 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3662f957-7643-4fe6-af44-45e9575d631b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:52.596371 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3662f957-7643-4fe6-af44-45e9575d631b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:52.605679 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3662f957-7643-4fe6-af44-45e9575d631b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:52.605679 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3662f957-7643-4fe6-af44-45e9575d631b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:52.743522 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3662f957-7643-4fe6-af44-45e9575d631b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:52.751648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3662f957-7643-4fe6-af44-45e9575d631b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1714 microversion: 2.1 time: 0.168223 Jun 23 20:13:52.762707 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 388/801] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:52 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1714 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:53.317442 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-71d6f989-9f6d-4a49-8776-2a12bee6f14e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:53.318599 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-71d6f989-9f6d-4a49-8776-2a12bee6f14e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:53.327061 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71d6f989-9f6d-4a49-8776-2a12bee6f14e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:53.327514 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71d6f989-9f6d-4a49-8776-2a12bee6f14e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:53.328287 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71d6f989-9f6d-4a49-8776-2a12bee6f14e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:53.328745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71d6f989-9f6d-4a49-8776-2a12bee6f14e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:53.463280 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-71d6f989-9f6d-4a49-8776-2a12bee6f14e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:53.470921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-71d6f989-9f6d-4a49-8776-2a12bee6f14e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.159023 Jun 23 20:13:53.471485 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 414/802] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:53 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:54.487815 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4d95b70e-7bb4-4114-92eb-7201f2d15a9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:54.488686 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4d95b70e-7bb4-4114-92eb-7201f2d15a9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:54.491929 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:54.495322 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d95b70e-7bb4-4114-92eb-7201f2d15a9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:54.501309 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d95b70e-7bb4-4114-92eb-7201f2d15a9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:54.501309 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d95b70e-7bb4-4114-92eb-7201f2d15a9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:54.501309 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4d95b70e-7bb4-4114-92eb-7201f2d15a9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:54.635463 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4d95b70e-7bb4-4114-92eb-7201f2d15a9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:54.643632 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4d95b70e-7bb4-4114-92eb-7201f2d15a9f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.159697 Jun 23 20:13:54.644190 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 389/803] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:54 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:54.869825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-2e2cdb16-a6b4-433e-adb3-e5478855742f req-8a685e34-af73-4cbb-a764-4c3446168e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a12f15d-0c87-4413-a893-463700ea1e11", "name": "network-vif-plugged", "status": "completed", "tag": "a261f993-dd66-47dc-9b31-a51d223f5302"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:54.878535 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-2e2cdb16-a6b4-433e-adb3-e5478855742f req-8a685e34-af73-4cbb-a764-4c3446168e90 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:54.878974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-2e2cdb16-a6b4-433e-adb3-e5478855742f req-8a685e34-af73-4cbb-a764-4c3446168e90 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:54.889479 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-2e2cdb16-a6b4-433e-adb3-e5478855742f req-8a685e34-af73-4cbb-a764-4c3446168e90 service nova] Creating event network-vif-plugged:a261f993-dd66-47dc-9b31-a51d223f5302 for instance 6a12f15d-0c87-4413-a893-463700ea1e11 on hv-cinder-84727 Jun 23 20:13:54.894123 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-2e2cdb16-a6b4-433e-adb3-e5478855742f req-8a685e34-af73-4cbb-a764-4c3446168e90 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028061 Jun 23 20:13:54.894682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 415/804] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:55.660346 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-732c5549-ae44-4a18-871c-ca6d35337dbb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:55.660948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-732c5549-ae44-4a18-871c-ca6d35337dbb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:55.667383 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-732c5549-ae44-4a18-871c-ca6d35337dbb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:55.667831 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-732c5549-ae44-4a18-871c-ca6d35337dbb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:55.668632 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-732c5549-ae44-4a18-871c-ca6d35337dbb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:55.669066 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-732c5549-ae44-4a18-871c-ca6d35337dbb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:55.671562 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:13:55.797183 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-732c5549-ae44-4a18-871c-ca6d35337dbb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:55.804426 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-732c5549-ae44-4a18-871c-ca6d35337dbb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1265 microversion: 2.1 time: 0.148041 Jun 23 20:13:55.805001 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 390/805] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:55 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:56.822448 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-948d8a90-4ab1-4ca5-bd5c-1ac29a3bf91f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:56.823139 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-948d8a90-4ab1-4ca5-bd5c-1ac29a3bf91f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:56.829700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-948d8a90-4ab1-4ca5-bd5c-1ac29a3bf91f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:56.830216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-948d8a90-4ab1-4ca5-bd5c-1ac29a3bf91f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:56.830974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-948d8a90-4ab1-4ca5-bd5c-1ac29a3bf91f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:56.831674 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-948d8a90-4ab1-4ca5-bd5c-1ac29a3bf91f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:56.968954 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-948d8a90-4ab1-4ca5-bd5c-1ac29a3bf91f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:56.977399 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-948d8a90-4ab1-4ca5-bd5c-1ac29a3bf91f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1453 microversion: 2.1 time: 0.159518 Jun 23 20:13:56.977890 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 416/806] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:56 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:57.002728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0e13aa66-efb6-4336-bed1-f1f18bd98b8f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:57.003298 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0e13aa66-efb6-4336-bed1-f1f18bd98b8f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:57.012117 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e13aa66-efb6-4336-bed1-f1f18bd98b8f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:57.012593 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e13aa66-efb6-4336-bed1-f1f18bd98b8f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:57.013371 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e13aa66-efb6-4336-bed1-f1f18bd98b8f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:57.013811 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0e13aa66-efb6-4336-bed1-f1f18bd98b8f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:57.141664 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-0e13aa66-efb6-4336-bed1-f1f18bd98b8f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:57.149028 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0e13aa66-efb6-4336-bed1-f1f18bd98b8f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1453 microversion: 2.1 time: 0.150341 Jun 23 20:13:57.149591 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 391/807] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:13:56 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:59.063839 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-89df1d99-57ca-4b15-b927-665e4fd1e89c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:59.066220 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-89df1d99-57ca-4b15-b927-665e4fd1e89c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:59.071326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-89df1d99-57ca-4b15-b927-665e4fd1e89c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:59.071767 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-89df1d99-57ca-4b15-b927-665e4fd1e89c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:59.072547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-89df1d99-57ca-4b15-b927-665e4fd1e89c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:59.072974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-89df1d99-57ca-4b15-b927-665e4fd1e89c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:59.104819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-89df1d99-57ca-4b15-b927-665e4fd1e89c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045054 Jun 23 20:13:59.105373 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 417/808] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jun 23 20:13:59 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:13:59.164699 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-13e73b28-3426-483f-a1d0-f73645ff606c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:59.165190 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-13e73b28-3426-483f-a1d0-f73645ff606c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:59.172268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-13e73b28-3426-483f-a1d0-f73645ff606c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:59.172268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-13e73b28-3426-483f-a1d0-f73645ff606c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:59.172979 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-13e73b28-3426-483f-a1d0-f73645ff606c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:59.173411 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-13e73b28-3426-483f-a1d0-f73645ff606c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:59.202341 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-13e73b28-3426-483f-a1d0-f73645ff606c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:13:59.531663 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-26de7b7f-a996-4549-945c-ebb4bec8d3ac req-20bdc36f-f76f-460f-9d60-9e734af665bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a12f15d-0c87-4413-a893-463700ea1e11", "tag": "a261f993-dd66-47dc-9b31-a51d223f5302"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:13:59.540591 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-26de7b7f-a996-4549-945c-ebb4bec8d3ac req-20bdc36f-f76f-460f-9d60-9e734af665bb service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:59.541362 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-26de7b7f-a996-4549-945c-ebb4bec8d3ac req-20bdc36f-f76f-460f-9d60-9e734af665bb service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:59.548451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-13e73b28-3426-483f-a1d0-f73645ff606c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 204 len: 0 microversion: 2.20 time: 0.386838 Jun 23 20:13:59.549783 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 392/809] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jun 23 20:13:59 2022] DELETE /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 20:13:59.559825 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:13:59.561386 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:13:59.564610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-26de7b7f-a996-4549-945c-ebb4bec8d3ac req-20bdc36f-f76f-460f-9d60-9e734af665bb service nova] Creating event network-changed:a261f993-dd66-47dc-9b31-a51d223f5302 for instance 6a12f15d-0c87-4413-a893-463700ea1e11 on hv-cinder-84727 Jun 23 20:13:59.570392 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-26de7b7f-a996-4549-945c-ebb4bec8d3ac req-20bdc36f-f76f-460f-9d60-9e734af665bb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042310 Jun 23 20:13:59.570607 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:59.570833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:59.571777 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:13:59.572173 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 418/810] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:13:59.572666 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:13:59.707285 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:59.715325 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:59.718566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:13:59.718566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-81ca88c1-82a5-4bf9-be73-e7d81bd61a7c tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.162666 Jun 23 20:13:59.729371 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 393/811] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:13:59 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:14:00.739117 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:00.741763 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:00.748133 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:00.748714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:00.749729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:00.750364 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:00.952972 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:00.961480 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:00.963123 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:00.964448 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2798cb46-ec62-4ba2-a0e7-0f4c14e7df95 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1724 microversion: 2.20 time: 0.230436 Jun 23 20:14:00.965313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 419/812] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:14:00 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 20:14:01.983435 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:01.984150 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:01.991160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:01.991600 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:01.992387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:01.993089 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:02.074933 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:02.083554 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:02.087833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3be90df779b4ddb8639d825fcb41234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9cca288b34019947e55d2a3112ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:02.087833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-69a0e226-be21-42ff-a089-2b731f4c4bcc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 200 len: 1656 microversion: 2.20 time: 0.107364 Jun 23 20:14:02.087833 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 394/813] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:14:01 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 1656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 20:14:02.348050 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-3818b56e-2f75-480e-bc9c-2b28b0118baa req-c2f887b7-4f8f-44e2-974e-46e4e879b3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfc5144-0d0f-4d88-bfef-d92a270ca655", "name": "network-vif-deleted", "tag": "048e62b5-3005-46cb-96bf-1c13423b57db"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:14:02.356767 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3818b56e-2f75-480e-bc9c-2b28b0118baa req-c2f887b7-4f8f-44e2-974e-46e4e879b3eb service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:02.357755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3818b56e-2f75-480e-bc9c-2b28b0118baa req-c2f887b7-4f8f-44e2-974e-46e4e879b3eb service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:02.368643 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-3818b56e-2f75-480e-bc9c-2b28b0118baa req-c2f887b7-4f8f-44e2-974e-46e4e879b3eb service nova] Creating event network-vif-deleted:048e62b5-3005-46cb-96bf-1c13423b57db for instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 on hv-cinder-84727 Jun 23 20:14:02.373535 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-3818b56e-2f75-480e-bc9c-2b28b0118baa req-c2f887b7-4f8f-44e2-974e-46e4e879b3eb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029188 Jun 23 20:14:02.374309 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 420/814] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:14:03.105129 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:03.105862 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:03.125913 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:03.127499 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:03.128682 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:03.129828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:03.148643 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] HTTP exception thrown: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Request method failure captured: Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 HTTP/1.1 Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMf0uaqil937gcP9xV5ItXVszyMMLKK8K8I9WZpYGIj7HOxDM0dU9Io-OYX5HdM8UFIR86e99io2hy33PTW0ErrLSiKdO96II2lOtkkB7Ua92vV8XYns4szEASvbiUTgl57p-DQbHxhK9M7b2fpXWcKFhg33uA8SbdP4w_Ml3YWO7YM Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:14:03.151798 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_71c9cca288b34019947e55d2a3112ddb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/71c9cca288b34019947e55d2a3112ddb"}]}] Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: a3be90df779b4ddb8639d825fcb41234 Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:03.153710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'dbfc5144-0d0f-4d88-bfef-d92a270ca655'} Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:14:03.154684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:03.156225 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:03.159457 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Returning 404 to user: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:14:03.161112 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7efc0444-6073-4911-b301-1111896bece5 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 404 len: 111 microversion: 2.20 time: 0.060164 Jun 23 20:14:03.162154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 395/815] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:14:03 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 20:14:03.172063 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e47a5098-c7f3-407b-ab63-f229681c0cae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '.version_select at 0x7f90de68c310>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:03.274367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e47a5098-c7f3-407b-ab63-f229681c0cae tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-640274661" status: 204 len: 0 microversion: 2.20 time: 0.107490 Jun 23 20:14:03.286104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 421/816] 10.222.0.44 () {60 vars in 1258 bytes} [Thu Jun 23 20:14:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-640274661 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 20:14:05.387007 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:05.387007 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:05.392643 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:05.393179 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:05.393952 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:05.394666 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:05.408422 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] HTTP exception thrown: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Request method failure captured: Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 HTTP/1.1 Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMf0uaqil937gcP9xV5ItXVszyMMLKK8K8I9WZpYGIj7HOxDM0dU9Io-OYX5HdM8UFIR86e99io2hy33PTW0ErrLSiKdO96II2lOtkkB7Ua92vV8XYns4szEASvbiUTgl57p-DQbHxhK9M7b2fpXWcKFhg33uA8SbdP4w_Ml3YWO7YM Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:14:05.410126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_71c9cca288b34019947e55d2a3112ddb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/71c9cca288b34019947e55d2a3112ddb"}]}] Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: a3be90df779b4ddb8639d825fcb41234 Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.411774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'dbfc5144-0d0f-4d88-bfef-d92a270ca655'} Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:14:05.412646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.414076 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.415523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Returning 404 to user: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:14:05.415523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a25fe226-c6f8-4e78-8666-f411e90fd011 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 404 len: 111 microversion: 2.20 time: 0.029927 Jun 23 20:14:05.415523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 396/817] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jun 23 20:14:05 2022] DELETE /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 20:14:05.420516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:05.421242 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: dbfc5144-0d0f-4d88-bfef-d92a270ca655] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:05.423689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:14:05.429233 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:05.429681 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:05.430430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:05.430869 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:05.444502 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] HTTP exception thrown: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Request method failure captured: Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 HTTP/1.1 Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMf0uaqil937gcP9xV5ItXVszyMMLKK8K8I9WZpYGIj7HOxDM0dU9Io-OYX5HdM8UFIR86e99io2hy33PTW0ErrLSiKdO96II2lOtkkB7Ua92vV8XYns4szEASvbiUTgl57p-DQbHxhK9M7b2fpXWcKFhg33uA8SbdP4w_Ml3YWO7YM Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:14:05.446132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_71c9cca288b34019947e55d2a3112ddb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/71c9cca288b34019947e55d2a3112ddb"}]}] Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: a3be90df779b4ddb8639d825fcb41234 Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.447676 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'dbfc5144-0d0f-4d88-bfef-d92a270ca655'} Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:14:05.448547 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. Jun 23 20:14:05.449790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:05.450928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Returning 404 to user: Instance dbfc5144-0d0f-4d88-bfef-d92a270ca655 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:14:05.450928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6752f40c-5545-4927-a577-a98c57615dbc tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655" status: 404 len: 111 microversion: 2.20 time: 0.031332 Jun 23 20:14:05.450928 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 422/818] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:14:05 2022] GET /compute/v2.1/servers/dbfc5144-0d0f-4d88-bfef-d92a270ca655 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 20:14:06.785965 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:06.789339 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:06.796579 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:06.797028 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:06.797791 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:06.798228 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:06.817186 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] HTTP exception thrown: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Request method failure captured: Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a HTTP/1.1 Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMf0uaqil937gcP9xV5ItXVszyMMLKK8K8I9WZpYGIj7HOxDM0dU9Io-OYX5HdM8UFIR86e99io2hy33PTW0ErrLSiKdO96II2lOtkkB7Ua92vV8XYns4szEASvbiUTgl57p-DQbHxhK9M7b2fpXWcKFhg33uA8SbdP4w_Ml3YWO7YM Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:14:06.818728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_71c9cca288b34019947e55d2a3112ddb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/71c9cca288b34019947e55d2a3112ddb"}]}] Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: a3be90df779b4ddb8639d825fcb41234 Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.820581 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a'} Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:14:06.823653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.826523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.828049 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Returning 404 to user: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:14:06.828049 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-de64b344-9b8d-44e8-bfed-b0478ba78413 tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "DELETE /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 404 len: 111 microversion: 2.20 time: 0.041443 Jun 23 20:14:06.828049 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 397/819] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jun 23 20:14:06 2022] DELETE /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 20:14:06.829011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:06.829618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] [instance: 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:06.836819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:06.837263 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:06.838022 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:06.838513 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:06.853411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] HTTP exception thrown: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Request method failure captured: Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a HTTP/1.1 Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMf0uaqil937gcP9xV5ItXVszyMMLKK8K8I9WZpYGIj7HOxDM0dU9Io-OYX5HdM8UFIR86e99io2hy33PTW0ErrLSiKdO96II2lOtkkB7Ua92vV8XYns4szEASvbiUTgl57p-DQbHxhK9M7b2fpXWcKFhg33uA8SbdP4w_Ml3YWO7YM Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:14:06.854951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_71c9cca288b34019947e55d2a3112ddb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/71c9cca288b34019947e55d2a3112ddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/71c9cca288b34019947e55d2a3112ddb"}]}] Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 71c9cca288b34019947e55d2a3112ddb Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141345298 Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: a3be90df779b4ddb8639d825fcb41234 Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141345298-project Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.862891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a'} Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:14:06.863772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. Jun 23 20:14:06.865773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:14:06.867037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] Returning 404 to user: Instance 03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:14:06.867037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f62828eb-4114-4bce-a4bb-56c7cab4e0bf tempest-AttachVolumeShelveTestJSON-2141345298 tempest-AttachVolumeShelveTestJSON-2141345298-project] 10.222.0.44 "GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a" status: 404 len: 111 microversion: 2.20 time: 0.031644 Jun 23 20:14:06.867037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 423/820] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 23 20:14:06 2022] GET /compute/v2.1/servers/03a48e1b-5b34-4d0b-9f3f-58ee9dd7553a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 20:14:34.195443 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e70caf06-f46e-4fe4-a987-9c10e478c51e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:34.195957 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e70caf06-f46e-4fe4-a987-9c10e478c51e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:34.198655 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:14:34.199298 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:14:34.204523 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e70caf06-f46e-4fe4-a987-9c10e478c51e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:34.204968 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e70caf06-f46e-4fe4-a987-9c10e478c51e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:34.205721 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e70caf06-f46e-4fe4-a987-9c10e478c51e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:34.206153 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e70caf06-f46e-4fe4-a987-9c10e478c51e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:34.289036 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-e70caf06-f46e-4fe4-a987-9c10e478c51e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'services' on Instance uuid 94c7d315-1803-43d6-929e-04e171f188a6 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:14:34.522879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e70caf06-f46e-4fe4-a987-9c10e478c51e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "DELETE /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/os-volume_attachments/0779c062-ce2f-43a2-91e5-7b03fbaea281" status: 202 len: 0 microversion: 2.1 time: 0.331104 Jun 23 20:14:34.523563 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 398/821] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:14:34 2022] DELETE /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/os-volume_attachments/0779c062-ce2f-43a2-91e5-7b03fbaea281 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:14:36.690902 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-67b10be9-706e-4ddc-a9f0-42389b671034 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:14:36.693662 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=45 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:14:36.699008 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-67b10be9-706e-4ddc-a9f0-42389b671034 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:36.699598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-67b10be9-706e-4ddc-a9f0-42389b671034 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:36.724215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-67b10be9-706e-4ddc-a9f0-42389b671034 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Going to try to stop instance {{(pid=118346) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 20:14:36.933012 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-67b10be9-706e-4ddc-a9f0-42389b671034 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/action" status: 202 len: 0 microversion: 2.1 time: 0.246793 Jun 23 20:14:36.933758 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 424/822] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:14:36 2022] POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:14:36.946782 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6f1ba0ae-59a2-4db3-831c-47624a0fb77e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:36.947397 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6f1ba0ae-59a2-4db3-831c-47624a0fb77e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:36.954618 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f1ba0ae-59a2-4db3-831c-47624a0fb77e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:36.954876 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f1ba0ae-59a2-4db3-831c-47624a0fb77e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:36.955640 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f1ba0ae-59a2-4db3-831c-47624a0fb77e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:36.956075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6f1ba0ae-59a2-4db3-831c-47624a0fb77e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:37.110405 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6f1ba0ae-59a2-4db3-831c-47624a0fb77e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:37.118180 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6f1ba0ae-59a2-4db3-831c-47624a0fb77e tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.176718 Jun 23 20:14:37.130001 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 399/823] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:36 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:38.143881 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e3ac3c69-f31e-4157-b38a-36cdba840679 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:38.144279 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e3ac3c69-f31e-4157-b38a-36cdba840679 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:38.151100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e3ac3c69-f31e-4157-b38a-36cdba840679 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:38.151525 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e3ac3c69-f31e-4157-b38a-36cdba840679 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:38.152287 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e3ac3c69-f31e-4157-b38a-36cdba840679 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:38.152749 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e3ac3c69-f31e-4157-b38a-36cdba840679 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:38.300203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e3ac3c69-f31e-4157-b38a-36cdba840679 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:38.315941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e3ac3c69-f31e-4157-b38a-36cdba840679 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.176748 Jun 23 20:14:38.316929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 425/824] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:38 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:39.334169 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-acad0280-185a-4997-a940-889e39c4f292 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:39.334774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-acad0280-185a-4997-a940-889e39c4f292 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:39.341383 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acad0280-185a-4997-a940-889e39c4f292 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:39.341834 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acad0280-185a-4997-a940-889e39c4f292 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:39.343350 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acad0280-185a-4997-a940-889e39c4f292 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:39.343350 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-acad0280-185a-4997-a940-889e39c4f292 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:39.476585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-acad0280-185a-4997-a940-889e39c4f292 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:39.484143 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-acad0280-185a-4997-a940-889e39c4f292 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.154516 Jun 23 20:14:39.484789 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 400/825] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:39 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:40.502713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3aa4d1c0-b912-41f3-a395-0b26639c334a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:40.503320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3aa4d1c0-b912-41f3-a395-0b26639c334a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:40.509751 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3aa4d1c0-b912-41f3-a395-0b26639c334a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:40.510203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3aa4d1c0-b912-41f3-a395-0b26639c334a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:40.510957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3aa4d1c0-b912-41f3-a395-0b26639c334a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:40.511392 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3aa4d1c0-b912-41f3-a395-0b26639c334a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:40.648045 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3aa4d1c0-b912-41f3-a395-0b26639c334a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:40.650159 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3aa4d1c0-b912-41f3-a395-0b26639c334a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.152514 Jun 23 20:14:40.650725 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 426/826] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:40 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:41.666760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be221f75-be47-400a-80aa-8054edd625ce tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:41.667360 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be221f75-be47-400a-80aa-8054edd625ce tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:41.674317 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be221f75-be47-400a-80aa-8054edd625ce tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:41.674757 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be221f75-be47-400a-80aa-8054edd625ce tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:41.675604 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be221f75-be47-400a-80aa-8054edd625ce tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:41.675920 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be221f75-be47-400a-80aa-8054edd625ce tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:41.807643 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be221f75-be47-400a-80aa-8054edd625ce tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:41.815908 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be221f75-be47-400a-80aa-8054edd625ce tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.153013 Jun 23 20:14:41.818915 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 401/827] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:41 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:42.834764 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6621c542-40d4-4019-9e64-dcc10a071874 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:42.835357 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6621c542-40d4-4019-9e64-dcc10a071874 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:42.841948 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6621c542-40d4-4019-9e64-dcc10a071874 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:42.842385 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6621c542-40d4-4019-9e64-dcc10a071874 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:42.843131 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6621c542-40d4-4019-9e64-dcc10a071874 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:42.843561 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6621c542-40d4-4019-9e64-dcc10a071874 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:42.968180 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-6621c542-40d4-4019-9e64-dcc10a071874 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:42.975520 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6621c542-40d4-4019-9e64-dcc10a071874 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.145453 Jun 23 20:14:42.976233 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 427/828] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:42 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:43.992495 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5a0015f1-f597-47c1-8e88-7c2c52c7deb4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:43.993109 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5a0015f1-f597-47c1-8e88-7c2c52c7deb4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:43.999492 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a0015f1-f597-47c1-8e88-7c2c52c7deb4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:43.999941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a0015f1-f597-47c1-8e88-7c2c52c7deb4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:44.000750 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a0015f1-f597-47c1-8e88-7c2c52c7deb4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:44.001189 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5a0015f1-f597-47c1-8e88-7c2c52c7deb4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:44.124488 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5a0015f1-f597-47c1-8e88-7c2c52c7deb4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:44.131800 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5a0015f1-f597-47c1-8e88-7c2c52c7deb4 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.143172 Jun 23 20:14:44.132385 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 402/829] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:43 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:45.148699 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8067277d-0e5e-4a79-a2f6-966e7a275402 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:45.149316 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8067277d-0e5e-4a79-a2f6-966e7a275402 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:45.155639 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8067277d-0e5e-4a79-a2f6-966e7a275402 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:45.156078 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8067277d-0e5e-4a79-a2f6-966e7a275402 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:45.156857 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8067277d-0e5e-4a79-a2f6-966e7a275402 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:45.157284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8067277d-0e5e-4a79-a2f6-966e7a275402 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:45.290409 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8067277d-0e5e-4a79-a2f6-966e7a275402 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:45.297750 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8067277d-0e5e-4a79-a2f6-966e7a275402 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.152862 Jun 23 20:14:45.298300 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 428/830] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:45 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:46.314732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d56d6754-930e-4fb0-9b23-40cb3d577840 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:46.315332 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d56d6754-930e-4fb0-9b23-40cb3d577840 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:46.322081 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d56d6754-930e-4fb0-9b23-40cb3d577840 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:46.322527 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d56d6754-930e-4fb0-9b23-40cb3d577840 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:46.323282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d56d6754-930e-4fb0-9b23-40cb3d577840 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:46.323725 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d56d6754-930e-4fb0-9b23-40cb3d577840 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:46.457391 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d56d6754-930e-4fb0-9b23-40cb3d577840 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:46.464767 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d56d6754-930e-4fb0-9b23-40cb3d577840 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.153866 Jun 23 20:14:46.465320 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 403/831] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:46 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:47.482037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e3cecd34-615e-49bd-867f-72495dc69531 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:47.482638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e3cecd34-615e-49bd-867f-72495dc69531 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:47.489821 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e3cecd34-615e-49bd-867f-72495dc69531 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:47.492843 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e3cecd34-615e-49bd-867f-72495dc69531 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:47.492843 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e3cecd34-615e-49bd-867f-72495dc69531 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:47.492843 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e3cecd34-615e-49bd-867f-72495dc69531 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:47.620978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e3cecd34-615e-49bd-867f-72495dc69531 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:47.628368 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e3cecd34-615e-49bd-867f-72495dc69531 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.150239 Jun 23 20:14:47.628927 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 429/832] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:47 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:48.645345 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c1efec34-e512-4e9d-975b-89447a443544 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:48.645918 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c1efec34-e512-4e9d-975b-89447a443544 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:48.652323 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1efec34-e512-4e9d-975b-89447a443544 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:48.652764 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1efec34-e512-4e9d-975b-89447a443544 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:48.653513 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1efec34-e512-4e9d-975b-89447a443544 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:48.653943 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1efec34-e512-4e9d-975b-89447a443544 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:48.779400 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c1efec34-e512-4e9d-975b-89447a443544 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:48.786941 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c1efec34-e512-4e9d-975b-89447a443544 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1678 microversion: 2.1 time: 0.146084 Jun 23 20:14:48.787506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 404/833] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:48 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:14:49.803675 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e9cb81d1-6980-402d-98de-efd736eb0f48 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:49.804263 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e9cb81d1-6980-402d-98de-efd736eb0f48 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:49.810247 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e9cb81d1-6980-402d-98de-efd736eb0f48 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:49.810693 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e9cb81d1-6980-402d-98de-efd736eb0f48 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:49.811447 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e9cb81d1-6980-402d-98de-efd736eb0f48 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:49.811884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e9cb81d1-6980-402d-98de-efd736eb0f48 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:49.938353 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e9cb81d1-6980-402d-98de-efd736eb0f48 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:49.946062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e9cb81d1-6980-402d-98de-efd736eb0f48 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1655 microversion: 2.1 time: 0.146476 Jun 23 20:14:49.946619 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 430/834] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:49 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:49.962810 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0673d493-55a2-4818-8b2d-fa26e98db5ff tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:14:49.969189 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0673d493-55a2-4818-8b2d-fa26e98db5ff tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:49.969636 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0673d493-55a2-4818-8b2d-fa26e98db5ff tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:49.991172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0673d493-55a2-4818-8b2d-fa26e98db5ff tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Going to try to start instance {{(pid=118345) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 20:14:50.155258 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0673d493-55a2-4818-8b2d-fa26e98db5ff tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/action" status: 202 len: 0 microversion: 2.1 time: 0.195999 Jun 23 20:14:50.155858 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 405/835] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:14:49 2022] POST /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:14:50.164459 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1539a244-45d2-4d81-9add-f5121c3bffda tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:50.165201 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1539a244-45d2-4d81-9add-f5121c3bffda tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:50.171146 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1539a244-45d2-4d81-9add-f5121c3bffda tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:50.171587 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1539a244-45d2-4d81-9add-f5121c3bffda tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:50.172355 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1539a244-45d2-4d81-9add-f5121c3bffda tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:50.172787 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1539a244-45d2-4d81-9add-f5121c3bffda tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:50.306893 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1539a244-45d2-4d81-9add-f5121c3bffda tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:50.314772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1539a244-45d2-4d81-9add-f5121c3bffda tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1664 microversion: 2.1 time: 0.153689 Jun 23 20:14:50.322098 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 431/836] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:50 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:51.332702 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a25a7dd9-5861-4945-9523-d51ba70d13e2 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:51.333386 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a25a7dd9-5861-4945-9523-d51ba70d13e2 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:51.339453 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a25a7dd9-5861-4945-9523-d51ba70d13e2 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:51.339896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a25a7dd9-5861-4945-9523-d51ba70d13e2 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:51.340665 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a25a7dd9-5861-4945-9523-d51ba70d13e2 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:51.341096 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a25a7dd9-5861-4945-9523-d51ba70d13e2 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:51.476150 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a25a7dd9-5861-4945-9523-d51ba70d13e2 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:51.483598 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a25a7dd9-5861-4945-9523-d51ba70d13e2 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1664 microversion: 2.1 time: 0.156362 Jun 23 20:14:51.484154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 406/837] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:51 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:52.502516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-642d2b8e-0503-46a5-8dfd-f460d525b677 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:52.504452 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-642d2b8e-0503-46a5-8dfd-f460d525b677 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:52.513808 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-642d2b8e-0503-46a5-8dfd-f460d525b677 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:52.514901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-642d2b8e-0503-46a5-8dfd-f460d525b677 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:52.516336 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-642d2b8e-0503-46a5-8dfd-f460d525b677 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:52.516937 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-642d2b8e-0503-46a5-8dfd-f460d525b677 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:52.668413 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-642d2b8e-0503-46a5-8dfd-f460d525b677 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:52.676898 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-642d2b8e-0503-46a5-8dfd-f460d525b677 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1664 microversion: 2.1 time: 0.179478 Jun 23 20:14:52.677495 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 432/838] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:52 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:14:53.694950 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-262503fd-5e84-48c0-b88b-ea84a70172bf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:14:53.695568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-262503fd-5e84-48c0-b88b-ea84a70172bf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:14:53.702205 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-262503fd-5e84-48c0-b88b-ea84a70172bf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:53.702698 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-262503fd-5e84-48c0-b88b-ea84a70172bf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:53.703460 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-262503fd-5e84-48c0-b88b-ea84a70172bf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:14:53.703889 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-262503fd-5e84-48c0-b88b-ea84a70172bf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:14:53.835733 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-262503fd-5e84-48c0-b88b-ea84a70172bf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:14:53.843206 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-262503fd-5e84-48c0-b88b-ea84a70172bf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1668 microversion: 2.1 time: 0.152851 Jun 23 20:14:53.843769 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 407/839] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:14:53 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:25.028238 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-872cdf74-cb8f-433d-a56e-55f30272aca0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Action: 'create', calling method: .version_select at 0x7f90d9f64430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-102557008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOzB598fuFNiG4MsackHgw4nrGq8w6eaTKDHv4OUNE+VQ0vqVqW4Gtl+iBfpXbYeyjLgekINhryIVGDKwuxHB1FpZzD24tLJ0I8bneONJ9nNR8ch3vdOW5AA4OmTZSXHA=="}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:25.032899 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=21 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:25.033576 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:25.047545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-872cdf74-cb8f-433d-a56e-55f30272aca0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Getting quotas for project a2028a4056254026b31f412942d1f576. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:15:25.054383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-872cdf74-cb8f-433d-a56e-55f30272aca0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Getting quotas for user a9fe5380b3974516ac4e5b2fd9284348 and project a2028a4056254026b31f412942d1f576. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:15:25.152921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-872cdf74-cb8f-433d-a56e-55f30272aca0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.128679 Jun 23 20:15:25.155006 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 433/840] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:15:25 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:15:25.249996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-51887510", "imageRef": "75fcc0e0-34e9-47c6-a6f8-f37eec915459", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-102557008", "networks": [{"uuid": "d45e4a79-07f1-4c09-96d8-8dd093721560"}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:25.257688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=20 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:25.258369 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:25.300819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] validate_networks() for [('d45e4a79-07f1-4c09-96d8-8dd093721560', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:15:25.671819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:15:25.672376 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:15:25.672876 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:15:25.673277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:15:25.673678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:15:25.683214 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:25.683655 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:25.684497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:25.684929 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:25.701752 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Getting quotas for project a2028a4056254026b31f412942d1f576. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:15:25.705737 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Getting quotas for user a9fe5380b3974516ac4e5b2fd9284348 and project a2028a4056254026b31f412942d1f576. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:15:25.716858 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:15:25.718978 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75fcc0e0-34e9-47c6-a6f8-f37eec915459',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:15:25.855079 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-272dbd01-c7b0-4909-bf14-e1d5f222a2fd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608840 Jun 23 20:15:25.855725 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 408/841] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:15:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:15:25.866119 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-24b4a2f6-9fe2-470e-8b60-41f90fd09c8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:25.867055 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-24b4a2f6-9fe2-470e-8b60-41f90fd09c8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:25.924027 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-24b4a2f6-9fe2-470e-8b60-41f90fd09c8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:25.930844 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-24b4a2f6-9fe2-470e-8b60-41f90fd09c8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1256 microversion: 2.1 time: 0.069201 Jun 23 20:15:25.931401 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 434/842] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:25 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:26.947706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-998ed5cd-875c-4ea8-b706-c738a3aa2eae tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:26.948684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-998ed5cd-875c-4ea8-b706-c738a3aa2eae tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:27.002629 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-998ed5cd-875c-4ea8-b706-c738a3aa2eae tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:27.011503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-998ed5cd-875c-4ea8-b706-c738a3aa2eae tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1256 microversion: 2.1 time: 0.068458 Jun 23 20:15:27.013062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 409/843] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:26 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:28.028334 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0dc817ec-ff16-47d0-a950-bc3076d8d515 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:28.028938 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0dc817ec-ff16-47d0-a950-bc3076d8d515 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:28.082791 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0dc817ec-ff16-47d0-a950-bc3076d8d515 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:28.090063 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0dc817ec-ff16-47d0-a950-bc3076d8d515 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1256 microversion: 2.1 time: 0.065598 Jun 23 20:15:28.090620 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 435/844] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:28 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1256 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:29.106872 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7e478d51-e5ca-4292-98f2-70838a0e9132 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:29.107481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7e478d51-e5ca-4292-98f2-70838a0e9132 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:29.161214 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7e478d51-e5ca-4292-98f2-70838a0e9132 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:29.167859 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7e478d51-e5ca-4292-98f2-70838a0e9132 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1256 microversion: 2.1 time: 0.064921 Jun 23 20:15:29.170420 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 410/845] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:29 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1256 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:30.185396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4a2f4272-6778-46fa-90ad-8ed6956d8ec7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:30.186000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4a2f4272-6778-46fa-90ad-8ed6956d8ec7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:30.192506 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4a2f4272-6778-46fa-90ad-8ed6956d8ec7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:30.192957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4a2f4272-6778-46fa-90ad-8ed6956d8ec7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:30.193704 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4a2f4272-6778-46fa-90ad-8ed6956d8ec7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:30.194136 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4a2f4272-6778-46fa-90ad-8ed6956d8ec7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:30.258580 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4a2f4272-6778-46fa-90ad-8ed6956d8ec7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:30.266165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4a2f4272-6778-46fa-90ad-8ed6956d8ec7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1260 microversion: 2.1 time: 0.084568 Jun 23 20:15:30.266716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 436/846] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:30 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1260 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:31.282685 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-02be2a00-b30a-4317-8c4d-7c8e5003b38d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:31.283282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-02be2a00-b30a-4317-8c4d-7c8e5003b38d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:31.290173 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02be2a00-b30a-4317-8c4d-7c8e5003b38d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:31.290615 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02be2a00-b30a-4317-8c4d-7c8e5003b38d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:31.291359 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02be2a00-b30a-4317-8c4d-7c8e5003b38d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:31.291839 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02be2a00-b30a-4317-8c4d-7c8e5003b38d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:31.353713 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-02be2a00-b30a-4317-8c4d-7c8e5003b38d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:31.361366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-02be2a00-b30a-4317-8c4d-7c8e5003b38d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1260 microversion: 2.1 time: 0.082542 Jun 23 20:15:31.361930 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 411/847] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:31 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1260 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:32.379112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2da391b8-b64c-4355-ba3e-9edc8b938333 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:32.379775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2da391b8-b64c-4355-ba3e-9edc8b938333 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:32.386331 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2da391b8-b64c-4355-ba3e-9edc8b938333 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:32.386777 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2da391b8-b64c-4355-ba3e-9edc8b938333 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:32.387538 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2da391b8-b64c-4355-ba3e-9edc8b938333 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:32.387975 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2da391b8-b64c-4355-ba3e-9edc8b938333 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:32.446294 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2da391b8-b64c-4355-ba3e-9edc8b938333 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:32.453530 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2da391b8-b64c-4355-ba3e-9edc8b938333 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1252 microversion: 2.1 time: 0.078841 Jun 23 20:15:32.454078 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 437/848] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:32 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1252 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:33.317200 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a5c70d79-2820-4770-a709-e91c66f1be18 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:33.318202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a5c70d79-2820-4770-a709-e91c66f1be18 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:33.324623 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5c70d79-2820-4770-a709-e91c66f1be18 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:33.325069 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5c70d79-2820-4770-a709-e91c66f1be18 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:33.325818 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5c70d79-2820-4770-a709-e91c66f1be18 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:33.326250 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a5c70d79-2820-4770-a709-e91c66f1be18 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:33.355999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a5c70d79-2820-4770-a709-e91c66f1be18 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042753 Jun 23 20:15:33.356569 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 412/849] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:15:33 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 20:15:33.412537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ad54af73-5aaa-4a3e-94a6-a180aed318d9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:33.413037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ad54af73-5aaa-4a3e-94a6-a180aed318d9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:33.419348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad54af73-5aaa-4a3e-94a6-a180aed318d9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:33.419798 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad54af73-5aaa-4a3e-94a6-a180aed318d9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:33.420573 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad54af73-5aaa-4a3e-94a6-a180aed318d9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:33.421010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ad54af73-5aaa-4a3e-94a6-a180aed318d9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:33.444827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ad54af73-5aaa-4a3e-94a6-a180aed318d9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:15:33.470746 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6d52057e-e903-4cac-acb4-d2e464bc33ac tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:33.471354 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6d52057e-e903-4cac-acb4-d2e464bc33ac tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:33.477961 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d52057e-e903-4cac-acb4-d2e464bc33ac tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:33.478409 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d52057e-e903-4cac-acb4-d2e464bc33ac tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:33.479215 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d52057e-e903-4cac-acb4-d2e464bc33ac tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:33.479656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d52057e-e903-4cac-acb4-d2e464bc33ac tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:33.539246 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6d52057e-e903-4cac-acb4-d2e464bc33ac tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:33.546538 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6d52057e-e903-4cac-acb4-d2e464bc33ac tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1252 microversion: 2.1 time: 0.079543 Jun 23 20:15:33.547092 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 413/850] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:33 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1252 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:15:33.762785 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ad54af73-5aaa-4a3e-94a6-a180aed318d9 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "DELETE /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 204 len: 0 microversion: 2.1 time: 0.354252 Jun 23 20:15:33.763300 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 438/851] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:15:33 2022] DELETE /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:15:33.772057 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b13aab31-c89c-4ab6-ac54-0a5d2fc0466f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:33.772694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b13aab31-c89c-4ab6-ac54-0a5d2fc0466f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:33.778672 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b13aab31-c89c-4ab6-ac54-0a5d2fc0466f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:33.779108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b13aab31-c89c-4ab6-ac54-0a5d2fc0466f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:33.779848 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b13aab31-c89c-4ab6-ac54-0a5d2fc0466f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:33.780277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b13aab31-c89c-4ab6-ac54-0a5d2fc0466f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:33.907533 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b13aab31-c89c-4ab6-ac54-0a5d2fc0466f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:33.914870 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b13aab31-c89c-4ab6-ac54-0a5d2fc0466f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1674 microversion: 2.1 time: 0.147226 Jun 23 20:15:33.915423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 414/852] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:33 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:34.563776 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d48a135d-a6bd-4916-891c-85b5d754bae9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:34.564495 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d48a135d-a6bd-4916-891c-85b5d754bae9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:34.570934 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d48a135d-a6bd-4916-891c-85b5d754bae9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:34.571375 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d48a135d-a6bd-4916-891c-85b5d754bae9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:34.572158 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d48a135d-a6bd-4916-891c-85b5d754bae9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:34.572611 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d48a135d-a6bd-4916-891c-85b5d754bae9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:34.633594 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d48a135d-a6bd-4916-891c-85b5d754bae9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:34.641032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d48a135d-a6bd-4916-891c-85b5d754bae9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1308 microversion: 2.1 time: 0.081454 Jun 23 20:15:34.641576 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 439/853] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:34 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1308 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:34.931894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-db65df28-a133-4cc3-a0ef-255be6481227 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:34.932434 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-db65df28-a133-4cc3-a0ef-255be6481227 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:34.938796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db65df28-a133-4cc3-a0ef-255be6481227 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:34.939238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db65df28-a133-4cc3-a0ef-255be6481227 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:34.939984 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db65df28-a133-4cc3-a0ef-255be6481227 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:34.940442 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db65df28-a133-4cc3-a0ef-255be6481227 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:35.070987 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-db65df28-a133-4cc3-a0ef-255be6481227 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:35.079337 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-db65df28-a133-4cc3-a0ef-255be6481227 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1674 microversion: 2.1 time: 0.150888 Jun 23 20:15:35.079337 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 415/854] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:34 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:35.656806 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f9f15ace-4d1a-40a3-8bca-1ac846e875a9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:35.657405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f9f15ace-4d1a-40a3-8bca-1ac846e875a9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:35.664078 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f9f15ace-4d1a-40a3-8bca-1ac846e875a9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:35.664550 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f9f15ace-4d1a-40a3-8bca-1ac846e875a9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:35.665305 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f9f15ace-4d1a-40a3-8bca-1ac846e875a9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:35.665733 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f9f15ace-4d1a-40a3-8bca-1ac846e875a9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:35.738429 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f9f15ace-4d1a-40a3-8bca-1ac846e875a9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:35.746107 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f9f15ace-4d1a-40a3-8bca-1ac846e875a9 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1308 microversion: 2.1 time: 0.093096 Jun 23 20:15:35.746662 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 440/855] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:35 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:36.097069 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6d57d031-6774-450d-8916-27b67b46a0f5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:36.098190 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6d57d031-6774-450d-8916-27b67b46a0f5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:36.100163 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:36.105492 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d57d031-6774-450d-8916-27b67b46a0f5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:36.105943 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d57d031-6774-450d-8916-27b67b46a0f5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:36.106703 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d57d031-6774-450d-8916-27b67b46a0f5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:36.107138 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d57d031-6774-450d-8916-27b67b46a0f5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:36.241732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6d57d031-6774-450d-8916-27b67b46a0f5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:36.249131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6d57d031-6774-450d-8916-27b67b46a0f5 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1674 microversion: 2.1 time: 0.155888 Jun 23 20:15:36.249645 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 416/856] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:36 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:36.765745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-25afc34c-9fd6-49c3-a3a9-5c70923dbdfc tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:36.765745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-25afc34c-9fd6-49c3-a3a9-5c70923dbdfc tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:36.772766 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25afc34c-9fd6-49c3-a3a9-5c70923dbdfc tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:36.773407 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25afc34c-9fd6-49c3-a3a9-5c70923dbdfc tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:36.775041 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25afc34c-9fd6-49c3-a3a9-5c70923dbdfc tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:36.775493 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-25afc34c-9fd6-49c3-a3a9-5c70923dbdfc tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:36.894912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-25afc34c-9fd6-49c3-a3a9-5c70923dbdfc tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:36.904741 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-25afc34c-9fd6-49c3-a3a9-5c70923dbdfc tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1308 microversion: 2.1 time: 0.144817 Jun 23 20:15:36.911083 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 441/857] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:36 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:37.265764 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b9aef2db-4709-4444-9c34-4e1a27b60cf6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:37.266373 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b9aef2db-4709-4444-9c34-4e1a27b60cf6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:37.275172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b9aef2db-4709-4444-9c34-4e1a27b60cf6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:37.275625 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b9aef2db-4709-4444-9c34-4e1a27b60cf6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:37.276412 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b9aef2db-4709-4444-9c34-4e1a27b60cf6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:37.276853 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b9aef2db-4709-4444-9c34-4e1a27b60cf6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:37.455220 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b9aef2db-4709-4444-9c34-4e1a27b60cf6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:37.476612 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b9aef2db-4709-4444-9c34-4e1a27b60cf6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1674 microversion: 2.1 time: 0.213201 Jun 23 20:15:37.477568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 417/858] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:37 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1674 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:37.922135 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d73862ac-7204-43c0-afc3-7743a9fd200b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:37.922779 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d73862ac-7204-43c0-afc3-7743a9fd200b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:37.947465 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-356a5302-3a9d-4aef-a34d-4c8e85eb36ed req-939e01c1-323b-4199-b090-27ab5f8d3242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c7d315-1803-43d6-929e-04e171f188a6", "name": "network-vif-deleted", "tag": "37c366c8-9439-4104-b866-3fbe24deff6b"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:37.952929 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d73862ac-7204-43c0-afc3-7743a9fd200b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:37.953667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d73862ac-7204-43c0-afc3-7743a9fd200b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:37.954671 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d73862ac-7204-43c0-afc3-7743a9fd200b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:37.955256 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d73862ac-7204-43c0-afc3-7743a9fd200b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:37.958998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-356a5302-3a9d-4aef-a34d-4c8e85eb36ed req-939e01c1-323b-4199-b090-27ab5f8d3242 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:37.966549 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-356a5302-3a9d-4aef-a34d-4c8e85eb36ed req-939e01c1-323b-4199-b090-27ab5f8d3242 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:38.018258 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-356a5302-3a9d-4aef-a34d-4c8e85eb36ed req-939e01c1-323b-4199-b090-27ab5f8d3242 service nova] Creating event network-vif-deleted:37c366c8-9439-4104-b866-3fbe24deff6b for instance 94c7d315-1803-43d6-929e-04e171f188a6 on hv-cinder-84727 Jun 23 20:15:38.033518 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-356a5302-3a9d-4aef-a34d-4c8e85eb36ed req-939e01c1-323b-4199-b090-27ab5f8d3242 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089754 Jun 23 20:15:38.044361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 418/859] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:15:38.087511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=8 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:38.161752 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d73862ac-7204-43c0-afc3-7743a9fd200b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:38.170983 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d73862ac-7204-43c0-afc3-7743a9fd200b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1314 microversion: 2.1 time: 0.252644 Jun 23 20:15:38.172105 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 442/860] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:37 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:38.497720 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:38.498631 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:38.516280 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:38.516698 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:38.520387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:38.522477 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:38.584388 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:38.584847 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:38.585306 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'fault' on Instance uuid 94c7d315-1803-43d6-929e-04e171f188a6 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:15:38.694144 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:38.702875 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f60bd708-d039-42e4-bcbf-0a07378b9b7f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1327 microversion: 2.1 time: 0.211660 Jun 23 20:15:38.715432 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 419/861] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:38 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1327 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:39.188822 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-336f1bbb-575a-4aea-b99f-067594b6e61c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:39.190135 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-336f1bbb-575a-4aea-b99f-067594b6e61c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:39.199711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-336f1bbb-575a-4aea-b99f-067594b6e61c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:39.200455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-336f1bbb-575a-4aea-b99f-067594b6e61c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:39.202076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-336f1bbb-575a-4aea-b99f-067594b6e61c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:39.202076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-336f1bbb-575a-4aea-b99f-067594b6e61c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:39.540739 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-336f1bbb-575a-4aea-b99f-067594b6e61c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:39.580225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-336f1bbb-575a-4aea-b99f-067594b6e61c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.395745 Jun 23 20:15:39.593575 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 443/862] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:39 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:39.725548 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:39.725548 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:39.735137 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=10 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:39.738497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:39.739361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:39.740427 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:39.745069 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:39.835230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:39.835786 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:39.836745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'fault' on Instance uuid 94c7d315-1803-43d6-929e-04e171f188a6 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:15:39.897764 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:39.919393 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-d1d91e67-a4f1-4c77-98ea-1dc26b0b9ecf tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1327 microversion: 2.1 time: 0.199937 Jun 23 20:15:39.929183 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 420/863] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:39 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1327 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:40.078740 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-3c854581-e1cc-40c9-8ee4-86bad14542e5 req-38d48b84-d118-4c1e-b1b5-657fa48ca8bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c6eafe-f596-4262-9487-4cd023a99823", "tag": "077883ce-f410-4855-8c89-e480ffa737bf"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:40.096347 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3c854581-e1cc-40c9-8ee4-86bad14542e5 req-38d48b84-d118-4c1e-b1b5-657fa48ca8bc service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:40.096800 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3c854581-e1cc-40c9-8ee4-86bad14542e5 req-38d48b84-d118-4c1e-b1b5-657fa48ca8bc service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:40.127476 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-3c854581-e1cc-40c9-8ee4-86bad14542e5 req-38d48b84-d118-4c1e-b1b5-657fa48ca8bc service nova] Creating event network-changed:077883ce-f410-4855-8c89-e480ffa737bf for instance e9c6eafe-f596-4262-9487-4cd023a99823 on hv-cinder-84727 Jun 23 20:15:40.136044 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-3c854581-e1cc-40c9-8ee4-86bad14542e5 req-38d48b84-d118-4c1e-b1b5-657fa48ca8bc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064578 Jun 23 20:15:40.138151 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 444/864] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:15:40.420209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:15:40.420891 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Thu Jun 23 20:15:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:15:40.606033 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a46552e6-9c48-47ce-bc78-0abbe5d36a7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:40.606634 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a46552e6-9c48-47ce-bc78-0abbe5d36a7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:40.613246 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a46552e6-9c48-47ce-bc78-0abbe5d36a7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:40.614001 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a46552e6-9c48-47ce-bc78-0abbe5d36a7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:40.614930 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a46552e6-9c48-47ce-bc78-0abbe5d36a7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:40.615521 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a46552e6-9c48-47ce-bc78-0abbe5d36a7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:40.796575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a46552e6-9c48-47ce-bc78-0abbe5d36a7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:40.808548 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a46552e6-9c48-47ce-bc78-0abbe5d36a7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.206579 Jun 23 20:15:40.809124 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 421/865] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:40 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:40.939618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:40.940673 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:40.947637 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:40.948104 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:40.948896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:40.949333 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:40.983649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:40.984170 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:40.984805 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'fault' on Instance uuid 94c7d315-1803-43d6-929e-04e171f188a6 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:15:41.035968 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:41.044614 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0dbcb267-00b6-4898-9750-7d3469ecea3d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1327 microversion: 2.1 time: 0.110727 Jun 23 20:15:41.045344 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 445/866] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:40 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:41.826175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-682b34a3-6f6b-4a3d-ad33-8601f770ea28 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:41.827429 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-682b34a3-6f6b-4a3d-ad33-8601f770ea28 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:41.835398 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-682b34a3-6f6b-4a3d-ad33-8601f770ea28 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:41.836043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-682b34a3-6f6b-4a3d-ad33-8601f770ea28 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:41.837032 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-682b34a3-6f6b-4a3d-ad33-8601f770ea28 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:41.837627 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-682b34a3-6f6b-4a3d-ad33-8601f770ea28 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:41.997357 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-682b34a3-6f6b-4a3d-ad33-8601f770ea28 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:42.006932 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-682b34a3-6f6b-4a3d-ad33-8601f770ea28 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.185381 Jun 23 20:15:42.007515 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 422/867] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:41 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:15:42.064003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:42.064774 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:42.072708 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:42.073330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:42.074248 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:42.075024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:42.116907 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:42.117273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:42.117724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'fault' on Instance uuid 94c7d315-1803-43d6-929e-04e171f188a6 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:15:42.163545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:42.176023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b9dc98fc-3375-45ae-bab7-d5b90680059a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1327 microversion: 2.1 time: 0.116034 Jun 23 20:15:42.177485 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 446/868] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:42 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:43.040109 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4a53b87f-2c5e-459f-9234-a787cd74cbab tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:43.040109 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4a53b87f-2c5e-459f-9234-a787cd74cbab tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:43.046545 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a53b87f-2c5e-459f-9234-a787cd74cbab tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:43.047002 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a53b87f-2c5e-459f-9234-a787cd74cbab tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:43.047810 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a53b87f-2c5e-459f-9234-a787cd74cbab tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:43.048251 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4a53b87f-2c5e-459f-9234-a787cd74cbab tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:43.194819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:43.195445 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:43.208082 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:43.208824 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:43.209613 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:43.210206 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:43.257236 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:43.258225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:43.258965 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'fault' on Instance uuid 94c7d315-1803-43d6-929e-04e171f188a6 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:15:43.506000 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4a53b87f-2c5e-459f-9234-a787cd74cbab tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:43.514195 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4a53b87f-2c5e-459f-9234-a787cd74cbab tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.482394 Jun 23 20:15:43.521788 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:43.525608 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 423/869] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:43 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:43.529838 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3787a8f4-a6fb-4617-ba05-10b25bfc968b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1327 microversion: 2.1 time: 0.339963 Jun 23 20:15:43.530700 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 447/870] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:43 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1327 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:15:44.536480 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a0af9832-981c-4741-9da2-949bcd6e8f3a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:44.537020 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a0af9832-981c-4741-9da2-949bcd6e8f3a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:44.543751 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0af9832-981c-4741-9da2-949bcd6e8f3a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:44.547934 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0af9832-981c-4741-9da2-949bcd6e8f3a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:44.547934 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0af9832-981c-4741-9da2-949bcd6e8f3a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:44.547934 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a0af9832-981c-4741-9da2-949bcd6e8f3a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:44.548183 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:44.548183 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:44.554857 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:44.555318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:44.556103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:44.556574 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:44.593799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:44.594247 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:44.594702 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'fault' on Instance uuid 94c7d315-1803-43d6-929e-04e171f188a6 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:15:44.673910 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:44.684756 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9d51257f-7d7b-4e6e-a9ff-b90d80a4f56b tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1327 microversion: 2.1 time: 0.141511 Jun 23 20:15:44.695492 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 448/871] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:44 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1327 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:15:44.739055 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a0af9832-981c-4741-9da2-949bcd6e8f3a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:44.749416 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a0af9832-981c-4741-9da2-949bcd6e8f3a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.217424 Jun 23 20:15:44.750134 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 424/872] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:44 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:45.703128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:45.703896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:45.711898 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:45.712727 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:45.713864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:45.714480 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:45.770177 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4392580d-453c-40e5-87a2-2111f08cd765 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:45.773084 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4392580d-453c-40e5-87a2-2111f08cd765 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:45.780421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4392580d-453c-40e5-87a2-2111f08cd765 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:45.781026 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:45.781309 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4392580d-453c-40e5-87a2-2111f08cd765 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:45.781507 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:45.781961 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'fault' on Instance uuid 94c7d315-1803-43d6-929e-04e171f188a6 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:15:45.782955 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4392580d-453c-40e5-87a2-2111f08cd765 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:45.785434 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4392580d-453c-40e5-87a2-2111f08cd765 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:45.826350 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:45.830175 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:45.837161 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-30176c43-1cc6-4d5c-8a4e-e6d1b0d34e85 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1327 microversion: 2.1 time: 0.138382 Jun 23 20:15:45.838262 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 449/873] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:45 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:46.006806 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4392580d-453c-40e5-87a2-2111f08cd765 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:46.020387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4392580d-453c-40e5-87a2-2111f08cd765 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.255870 Jun 23 20:15:46.020883 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 425/874] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:45 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:46.855806 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:46.856628 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:46.863701 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:46.864142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:46.864944 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:46.865384 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:46.898436 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:46.898911 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:46.899553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'fault' on Instance uuid 94c7d315-1803-43d6-929e-04e171f188a6 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:15:46.976242 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:46.983913 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b1ee1892-60c9-420e-b6ec-7452ac0ac811 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 200 len: 1327 microversion: 2.1 time: 0.132365 Jun 23 20:15:46.984501 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 450/875] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:46 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:47.038585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-3d57d804-8bff-45f7-90b0-c71b0c2ee66b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:47.039999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-3d57d804-8bff-45f7-90b0-c71b0c2ee66b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:47.049367 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d57d804-8bff-45f7-90b0-c71b0c2ee66b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:47.049903 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d57d804-8bff-45f7-90b0-c71b0c2ee66b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:47.050801 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d57d804-8bff-45f7-90b0-c71b0c2ee66b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:47.051233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-3d57d804-8bff-45f7-90b0-c71b0c2ee66b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:47.268223 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-3d57d804-8bff-45f7-90b0-c71b0c2ee66b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:47.276560 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-3d57d804-8bff-45f7-90b0-c71b0c2ee66b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.242413 Jun 23 20:15:47.277445 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 426/876] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:47 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:48.001193 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:48.001794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:48.008326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:48.008807 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:48.009562 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:48.010000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:48.025413 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] HTTP exception thrown: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Request method failure captured: Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 HTTP/1.1 Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMkhch8XWZNJTYFewOy8x-dPyO5Cw5-Sm5ZLtRwWXtFp6UlhOEnRVywNTfpi3fnqWsK1hfd2Xr7UBEM93BI0VcLY7Rzo4tHm-V7JkbF0SV4hMB9Iz4V_RtaHHlxzmKF57pXgeaY-yoFuKd82iQjabnC7ISu9pavDbXf1jMySP5C3OXk Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:15:48.027067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ed44d3eff7af4bd1bc339244e2bc2fae", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ed44d3eff7af4bd1bc339244e2bc2fae"}]}] Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 2c5e6ea89435497c8b1b06f42e08c82e Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:15:48.031570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '94c7d315-1803-43d6-929e-04e171f188a6'} Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:15:48.032635 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:15:48.033904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:15:48.035040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Returning 404 to user: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:15:48.035040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9bbe4ce8-b4d9-42a7-a811-88e53ab9f556 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 404 len: 111 microversion: 2.1 time: 0.031611 Jun 23 20:15:48.035040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 451/877] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:47 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:15:48.038027 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-954fbe9f-1858-4be4-b154-4a25e3343273 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '.version_select at 0x7f90de608820>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:48.113039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-954fbe9f-1858-4be4-b154-4a25e3343273 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-326423697" status: 202 len: 0 microversion: 2.1 time: 0.079178 Jun 23 20:15:48.113799 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 427/878] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 23 20:15:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-326423697 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:15:48.294021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e866e155-d0d9-4037-b526-bf5553b99c62 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:48.294627 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e866e155-d0d9-4037-b526-bf5553b99c62 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:48.300924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e866e155-d0d9-4037-b526-bf5553b99c62 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:48.301369 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e866e155-d0d9-4037-b526-bf5553b99c62 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:48.302143 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e866e155-d0d9-4037-b526-bf5553b99c62 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:48.305337 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e866e155-d0d9-4037-b526-bf5553b99c62 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:48.563505 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e866e155-d0d9-4037-b526-bf5553b99c62 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:48.572703 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e866e155-d0d9-4037-b526-bf5553b99c62 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.282960 Jun 23 20:15:48.573276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 452/879] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:48 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:48.947791 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-67ba08c3-440e-4a23-bafc-2103a93ae7cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'create', calling method: .version_select at 0x7f90d9d49b80>, body: {"keypair": {"name": "tempest-keypair-699931145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuUbqRav1MS4h26rkNNMcxLQdkLieZAreMTg7m+F2Y3+GFQBXWur+cnj2oDCT8LbAL+Nd97HwuWE9HO+11po5/KpKSXnLMIxMJTMzfXDFh0ryr9jjnExq1ftBn+caDEAg=="}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:48.964759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-67ba08c3-440e-4a23-bafc-2103a93ae7cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Getting quotas for project ed44d3eff7af4bd1bc339244e2bc2fae. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:15:48.969090 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-67ba08c3-440e-4a23-bafc-2103a93ae7cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Getting quotas for user 2c5e6ea89435497c8b1b06f42e08c82e and project ed44d3eff7af4bd1bc339244e2bc2fae. Resources: {'key_pairs'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:15:49.055906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-67ba08c3-440e-4a23-bafc-2103a93ae7cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111915 Jun 23 20:15:49.056635 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 428/880] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:15:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:15:49.590807 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a9635bde-5a44-407c-b436-6b287ce9509f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:49.591395 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a9635bde-5a44-407c-b436-6b287ce9509f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:49.599269 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9635bde-5a44-407c-b436-6b287ce9509f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:49.599814 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9635bde-5a44-407c-b436-6b287ce9509f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:49.600683 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9635bde-5a44-407c-b436-6b287ce9509f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:49.601184 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a9635bde-5a44-407c-b436-6b287ce9509f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:49.756857 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a9635bde-5a44-407c-b436-6b287ce9509f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:49.764292 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a9635bde-5a44-407c-b436-6b287ce9509f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.177900 Jun 23 20:15:49.764865 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 453/881] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:49 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:50.785745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8434d125-e519-4044-a814-e52a4d2624ce tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:50.786280 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8434d125-e519-4044-a814-e52a4d2624ce tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:50.792291 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8434d125-e519-4044-a814-e52a4d2624ce tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:50.792783 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8434d125-e519-4044-a814-e52a4d2624ce tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:50.799462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8434d125-e519-4044-a814-e52a4d2624ce tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:50.799462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8434d125-e519-4044-a814-e52a4d2624ce tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:50.799462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:50.975922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-8434d125-e519-4044-a814-e52a4d2624ce tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:50.983528 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8434d125-e519-4044-a814-e52a4d2624ce tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.202332 Jun 23 20:15:50.988759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 429/882] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:50 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:51.434754 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1848682627", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d5d57f3-4510-4872-96be-48a3a247b8dc"}], "security_groups": [{"name": "tempest-securitygroup--1727043059"}], "key_name": "tempest-keypair-699931145", "user_data": "}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:51.512887 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-9cde55cd-b6c0-4676-aeb7-ffd6954ea497 req-631bdf26-483b-49ab-bf08-830117f94f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c6eafe-f596-4262-9487-4cd023a99823", "name": "network-vif-plugged", "status": "completed", "tag": "077883ce-f410-4855-8c89-e480ffa737bf"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:51.521757 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-9cde55cd-b6c0-4676-aeb7-ffd6954ea497 req-631bdf26-483b-49ab-bf08-830117f94f8a service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:51.526780 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-9cde55cd-b6c0-4676-aeb7-ffd6954ea497 req-631bdf26-483b-49ab-bf08-830117f94f8a service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:51.533293 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-9cde55cd-b6c0-4676-aeb7-ffd6954ea497 req-631bdf26-483b-49ab-bf08-830117f94f8a service nova] Creating event network-vif-plugged:077883ce-f410-4855-8c89-e480ffa737bf for instance e9c6eafe-f596-4262-9487-4cd023a99823 on hv-cinder-84727 Jun 23 20:15:51.538823 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-9cde55cd-b6c0-4676-aeb7-ffd6954ea497 req-631bdf26-483b-49ab-bf08-830117f94f8a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030285 Jun 23 20:15:51.540785 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] validate_networks() for [('6d5d57f3-4510-4872-96be-48a3a247b8dc', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:15:51.542079 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 430/883] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:15:51.939145 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:15:51.939574 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:15:51.940053 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:15:51.940501 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:15:51.940912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:15:51.950246 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:51.950697 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:51.951496 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:51.951935 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:51.970038 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Getting quotas for project ed44d3eff7af4bd1bc339244e2bc2fae. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:15:51.974711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Getting quotas for user 2c5e6ea89435497c8b1b06f42e08c82e and project ed44d3eff7af4bd1bc339244e2bc2fae. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:15:51.985759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:15:51.988024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:15:52.001154 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-35923cba-3953-4186-9bb2-b0fa1e1cc867 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:52.001856 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-35923cba-3953-4186-9bb2-b0fa1e1cc867 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:52.009105 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-35923cba-3953-4186-9bb2-b0fa1e1cc867 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:52.009558 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-35923cba-3953-4186-9bb2-b0fa1e1cc867 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:52.010386 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-35923cba-3953-4186-9bb2-b0fa1e1cc867 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:52.010828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-35923cba-3953-4186-9bb2-b0fa1e1cc867 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:52.113953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fb050e82-0c6d-4615-aa7c-2c29e61eca3f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.683385 Jun 23 20:15:52.115034 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 454/884] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:15:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:15:52.124403 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-30b433ea-81ef-46ae-8dce-928d0983fce1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:52.125254 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-30b433ea-81ef-46ae-8dce-928d0983fce1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:52.139982 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-35923cba-3953-4186-9bb2-b0fa1e1cc867 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:52.149672 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-35923cba-3953-4186-9bb2-b0fa1e1cc867 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.153167 Jun 23 20:15:52.151095 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 431/885] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:51 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:15:52.194626 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-30b433ea-81ef-46ae-8dce-928d0983fce1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:52.202156 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-30b433ea-81ef-46ae-8dce-928d0983fce1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1237 microversion: 2.1 time: 0.081491 Jun 23 20:15:52.202790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 455/886] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:52 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:15:53.167531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2c6b3a5d-6d56-4a88-b8e5-367dc59dd9c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:53.168140 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2c6b3a5d-6d56-4a88-b8e5-367dc59dd9c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:53.174638 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c6b3a5d-6d56-4a88-b8e5-367dc59dd9c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:53.175088 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c6b3a5d-6d56-4a88-b8e5-367dc59dd9c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:53.175845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c6b3a5d-6d56-4a88-b8e5-367dc59dd9c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:53.176282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2c6b3a5d-6d56-4a88-b8e5-367dc59dd9c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:53.221127 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e49dc56d-7c7a-4e3f-894e-0ce7e43da7d1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:53.221959 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e49dc56d-7c7a-4e3f-894e-0ce7e43da7d1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:53.230864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e49dc56d-7c7a-4e3f-894e-0ce7e43da7d1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:53.231706 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e49dc56d-7c7a-4e3f-894e-0ce7e43da7d1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:53.232698 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e49dc56d-7c7a-4e3f-894e-0ce7e43da7d1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:53.233293 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e49dc56d-7c7a-4e3f-894e-0ce7e43da7d1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:53.313605 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e49dc56d-7c7a-4e3f-894e-0ce7e43da7d1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:53.322321 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e49dc56d-7c7a-4e3f-894e-0ce7e43da7d1 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1241 microversion: 2.1 time: 0.104701 Jun 23 20:15:53.322884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 456/887] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:53 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:15:53.336490 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2c6b3a5d-6d56-4a88-b8e5-367dc59dd9c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:53.350836 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2c6b3a5d-6d56-4a88-b8e5-367dc59dd9c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1356 microversion: 2.1 time: 0.179984 Jun 23 20:15:53.351464 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 432/888] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:53 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1356 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:54.338876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2d99d44b-eb87-4443-afb3-5ba13c3566d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:54.339484 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2d99d44b-eb87-4443-afb3-5ba13c3566d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:54.343536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:54.347003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2d99d44b-eb87-4443-afb3-5ba13c3566d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:54.349470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2d99d44b-eb87-4443-afb3-5ba13c3566d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:54.349470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2d99d44b-eb87-4443-afb3-5ba13c3566d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:54.349470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2d99d44b-eb87-4443-afb3-5ba13c3566d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:54.367506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-77bec88c-97ee-4f4b-8f94-ace2e8b6bcf5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:54.368200 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-77bec88c-97ee-4f4b-8f94-ace2e8b6bcf5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:54.374751 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-77bec88c-97ee-4f4b-8f94-ace2e8b6bcf5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:54.375396 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-77bec88c-97ee-4f4b-8f94-ace2e8b6bcf5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:54.376389 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-77bec88c-97ee-4f4b-8f94-ace2e8b6bcf5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:54.376828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-77bec88c-97ee-4f4b-8f94-ace2e8b6bcf5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:54.418293 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2d99d44b-eb87-4443-afb3-5ba13c3566d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:54.426493 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2d99d44b-eb87-4443-afb3-5ba13c3566d0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1289 microversion: 2.1 time: 0.091691 Jun 23 20:15:54.428595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 457/889] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:54 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:54.709102 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-77bec88c-97ee-4f4b-8f94-ace2e8b6bcf5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:54.716541 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-77bec88c-97ee-4f4b-8f94-ace2e8b6bcf5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1546 microversion: 2.1 time: 0.353417 Jun 23 20:15:54.717106 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 433/890] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:54 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1546 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:15:54.734181 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-95873798-c63f-48b9-9402-ad941240b7a7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:54.736837 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-95873798-c63f-48b9-9402-ad941240b7a7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:54.742055 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95873798-c63f-48b9-9402-ad941240b7a7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:54.742564 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95873798-c63f-48b9-9402-ad941240b7a7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:54.743526 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95873798-c63f-48b9-9402-ad941240b7a7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:54.744371 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-95873798-c63f-48b9-9402-ad941240b7a7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:54.923362 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-95873798-c63f-48b9-9402-ad941240b7a7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:54.931035 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-95873798-c63f-48b9-9402-ad941240b7a7 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1546 microversion: 2.1 time: 0.201371 Jun 23 20:15:54.931813 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 458/891] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:54 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:54.946569 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9f50d329-e539-46b7-a0d4-70aa4e1c2cd8 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:54.950367 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9f50d329-e539-46b7-a0d4-70aa4e1c2cd8 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:54.950940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9f50d329-e539-46b7-a0d4-70aa4e1c2cd8 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Searching by: {'deleted': False, 'project_id': 'a2028a4056254026b31f412942d1f576'} {{(pid=118345) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 20:15:54.958036 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9f50d329-e539-46b7-a0d4-70aa4e1c2cd8 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:54.959220 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9f50d329-e539-46b7-a0d4-70aa4e1c2cd8 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:54.960017 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9f50d329-e539-46b7-a0d4-70aa4e1c2cd8 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:54.960481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9f50d329-e539-46b7-a0d4-70aa4e1c2cd8 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:55.049913 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.multi_cell_list [None req-9f50d329-e539-46b7-a0d4-70aa4e1c2cd8 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118345) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 20:15:55.145514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9f50d329-e539-46b7-a0d4-70aa4e1c2cd8 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.202540 Jun 23 20:15:55.146657 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 434/892] 10.222.0.44 () {58 vars in 1124 bytes} [Thu Jun 23 20:15:54 2022] GET /compute/v2.1/servers => generated 341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:15:55.157022 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2abd2f49-606d-4aee-95fd-43af47946b8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:55.158252 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2abd2f49-606d-4aee-95fd-43af47946b8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:55.164371 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2abd2f49-606d-4aee-95fd-43af47946b8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:55.165281 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2abd2f49-606d-4aee-95fd-43af47946b8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:55.165575 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2abd2f49-606d-4aee-95fd-43af47946b8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:55.166009 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2abd2f49-606d-4aee-95fd-43af47946b8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:55.382565 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2abd2f49-606d-4aee-95fd-43af47946b8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:55.390250 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2abd2f49-606d-4aee-95fd-43af47946b8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1546 microversion: 2.1 time: 0.237111 Jun 23 20:15:55.390804 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 459/893] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:55 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1546 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:55.445440 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2be53833-d856-4002-84d7-9cfcb36c378a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:55.446053 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2be53833-d856-4002-84d7-9cfcb36c378a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:55.448602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:55.453373 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2be53833-d856-4002-84d7-9cfcb36c378a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:55.453817 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2be53833-d856-4002-84d7-9cfcb36c378a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:55.454793 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2be53833-d856-4002-84d7-9cfcb36c378a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:55.455230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2be53833-d856-4002-84d7-9cfcb36c378a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:55.522971 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2be53833-d856-4002-84d7-9cfcb36c378a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:55.531493 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2be53833-d856-4002-84d7-9cfcb36c378a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1295 microversion: 2.1 time: 0.090851 Jun 23 20:15:55.540449 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 435/894] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:55 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:56.549207 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c1237118-d6b2-4fa2-a499-af2966c546df tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:56.551988 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c1237118-d6b2-4fa2-a499-af2966c546df tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:56.557186 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c1237118-d6b2-4fa2-a499-af2966c546df tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:56.558212 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c1237118-d6b2-4fa2-a499-af2966c546df tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:56.559860 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c1237118-d6b2-4fa2-a499-af2966c546df tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:56.560962 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c1237118-d6b2-4fa2-a499-af2966c546df tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:56.579038 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-890ea74d-7d9b-4e99-8f27-6bb0a206bdf1 req-97940de7-832a-42ea-aeb4-a06291939f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf4d745-73cd-458d-9aa6-cef42480b9f2", "tag": "20228e09-3cd8-4ebb-a57a-0b23971f8745"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:56.602126 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-890ea74d-7d9b-4e99-8f27-6bb0a206bdf1 req-97940de7-832a-42ea-aeb4-a06291939f99 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:56.602611 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-890ea74d-7d9b-4e99-8f27-6bb0a206bdf1 req-97940de7-832a-42ea-aeb4-a06291939f99 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:56.620026 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-890ea74d-7d9b-4e99-8f27-6bb0a206bdf1 req-97940de7-832a-42ea-aeb4-a06291939f99 service nova] Creating event network-changed:20228e09-3cd8-4ebb-a57a-0b23971f8745 for instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 on hv-cinder-84727 Jun 23 20:15:56.625968 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-890ea74d-7d9b-4e99-8f27-6bb0a206bdf1 req-97940de7-832a-42ea-aeb4-a06291939f99 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054435 Jun 23 20:15:56.627020 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 436/895] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:15:57.053542 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c1237118-d6b2-4fa2-a499-af2966c546df tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:57.061935 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c1237118-d6b2-4fa2-a499-af2966c546df tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.517223 Jun 23 20:15:57.065000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 460/896] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:56 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:57.302826 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-40e167f5-a42f-4ae5-8e1b-0c05d43062f2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91d5c42e-846f-4249-b04f-24476e1865a7"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:57.302826 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-40e167f5-a42f-4ae5-8e1b-0c05d43062f2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:57.307003 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40e167f5-a42f-4ae5-8e1b-0c05d43062f2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:57.308185 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40e167f5-a42f-4ae5-8e1b-0c05d43062f2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:57.311667 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40e167f5-a42f-4ae5-8e1b-0c05d43062f2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:57.312129 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-40e167f5-a42f-4ae5-8e1b-0c05d43062f2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:57.748089 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d8a30e54-8122-4d53-a31f-52083c734c63 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:57.749236 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d8a30e54-8122-4d53-a31f-52083c734c63 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:57.756536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d8a30e54-8122-4d53-a31f-52083c734c63 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:57.756536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d8a30e54-8122-4d53-a31f-52083c734c63 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:57.757680 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d8a30e54-8122-4d53-a31f-52083c734c63 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:57.758112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d8a30e54-8122-4d53-a31f-52083c734c63 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:57.789643 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d8a30e54-8122-4d53-a31f-52083c734c63 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:15:58.029480 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-40e167f5-a42f-4ae5-8e1b-0c05d43062f2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "POST /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735414 Jun 23 20:15:58.030261 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 437/897] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:15:57 2022] POST /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:15:58.065729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d8a30e54-8122-4d53-a31f-52083c734c63 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 204 len: 0 microversion: 2.1 time: 0.322778 Jun 23 20:15:58.066426 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 461/898] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:15:57 2022] DELETE /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:15:58.076465 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-edba6d13-6653-4508-a660-0ec4ec4da188 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:58.077335 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-edba6d13-6653-4508-a660-0ec4ec4da188 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:58.085918 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-edba6d13-6653-4508-a660-0ec4ec4da188 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:58.086373 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-edba6d13-6653-4508-a660-0ec4ec4da188 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:58.093606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-edba6d13-6653-4508-a660-0ec4ec4da188 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:58.093606 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-edba6d13-6653-4508-a660-0ec4ec4da188 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:58.201400 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-f06df7c7-739d-4fc1-a64f-e1d8730ef6d9 req-50e67993-cfaa-4cad-9987-0c5b5d261012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a12f15d-0c87-4413-a893-463700ea1e11", "tag": "a261f993-dd66-47dc-9b31-a51d223f5302"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:15:58.211452 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f06df7c7-739d-4fc1-a64f-e1d8730ef6d9 req-50e67993-cfaa-4cad-9987-0c5b5d261012 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:58.211893 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-f06df7c7-739d-4fc1-a64f-e1d8730ef6d9 req-50e67993-cfaa-4cad-9987-0c5b5d261012 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:58.223764 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-f06df7c7-739d-4fc1-a64f-e1d8730ef6d9 req-50e67993-cfaa-4cad-9987-0c5b5d261012 service nova] Creating event network-changed:a261f993-dd66-47dc-9b31-a51d223f5302 for instance 6a12f15d-0c87-4413-a893-463700ea1e11 on hv-cinder-84727 Jun 23 20:15:58.228966 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-f06df7c7-739d-4fc1-a64f-e1d8730ef6d9 req-50e67993-cfaa-4cad-9987-0c5b5d261012 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197103 Jun 23 20:15:58.230025 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 438/899] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:15:58.236605 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-185730ec-8d08-4974-94b3-d1bb811db411 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:58.238742 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-185730ec-8d08-4974-94b3-d1bb811db411 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:58.245731 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-185730ec-8d08-4974-94b3-d1bb811db411 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:58.246171 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-185730ec-8d08-4974-94b3-d1bb811db411 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:58.246948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-185730ec-8d08-4974-94b3-d1bb811db411 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:58.247099 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-edba6d13-6653-4508-a660-0ec4ec4da188 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:58.247387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-185730ec-8d08-4974-94b3-d1bb811db411 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:58.255463 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-edba6d13-6653-4508-a660-0ec4ec4da188 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1578 microversion: 2.1 time: 0.183439 Jun 23 20:15:58.256416 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 462/900] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:58 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:58.386624 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-185730ec-8d08-4974-94b3-d1bb811db411 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:58.394068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-185730ec-8d08-4974-94b3-d1bb811db411 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.162545 Jun 23 20:15:58.394626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 439/901] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:58 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:59.274869 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-32955dea-b323-44b9-84f1-f2b9d47ca7ac tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:59.275474 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-32955dea-b323-44b9-84f1-f2b9d47ca7ac tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:59.281990 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-32955dea-b323-44b9-84f1-f2b9d47ca7ac tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:59.282435 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-32955dea-b323-44b9-84f1-f2b9d47ca7ac tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:59.283187 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-32955dea-b323-44b9-84f1-f2b9d47ca7ac tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:59.283618 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-32955dea-b323-44b9-84f1-f2b9d47ca7ac tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:59.411056 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a47bf72f-4446-431a-a58d-b4feb9482fe3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:15:59.412330 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a47bf72f-4446-431a-a58d-b4feb9482fe3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:15:59.412939 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-32955dea-b323-44b9-84f1-f2b9d47ca7ac tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:59.414792 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=4 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:15:59.419861 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a47bf72f-4446-431a-a58d-b4feb9482fe3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:59.420323 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a47bf72f-4446-431a-a58d-b4feb9482fe3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:59.420921 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-32955dea-b323-44b9-84f1-f2b9d47ca7ac tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1578 microversion: 2.1 time: 0.150392 Jun 23 20:15:59.421095 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a47bf72f-4446-431a-a58d-b4feb9482fe3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:15:59.421492 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 463/902] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:59 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:15:59.427594 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a47bf72f-4446-431a-a58d-b4feb9482fe3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:15:59.557953 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a47bf72f-4446-431a-a58d-b4feb9482fe3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:15:59.565265 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a47bf72f-4446-431a-a58d-b4feb9482fe3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.158093 Jun 23 20:15:59.565825 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 440/903] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:15:59 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:00.439288 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8372d1d6-022b-4cb8-8214-03f128560ace tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:00.439958 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8372d1d6-022b-4cb8-8214-03f128560ace tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:00.446398 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8372d1d6-022b-4cb8-8214-03f128560ace tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:00.446846 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8372d1d6-022b-4cb8-8214-03f128560ace tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:00.447604 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8372d1d6-022b-4cb8-8214-03f128560ace tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:00.448039 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8372d1d6-022b-4cb8-8214-03f128560ace tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:00.582723 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2db5193d-edbc-41ad-a99d-da8d47e0b77c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:00.584147 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2db5193d-edbc-41ad-a99d-da8d47e0b77c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:00.587472 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8372d1d6-022b-4cb8-8214-03f128560ace tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:00.590801 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2db5193d-edbc-41ad-a99d-da8d47e0b77c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:00.591262 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2db5193d-edbc-41ad-a99d-da8d47e0b77c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:00.592062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2db5193d-edbc-41ad-a99d-da8d47e0b77c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:00.592535 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2db5193d-edbc-41ad-a99d-da8d47e0b77c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:00.595196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8372d1d6-022b-4cb8-8214-03f128560ace tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1578 microversion: 2.1 time: 0.159847 Jun 23 20:16:00.595943 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 464/904] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:00 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:00.719003 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2db5193d-edbc-41ad-a99d-da8d47e0b77c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:00.726383 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2db5193d-edbc-41ad-a99d-da8d47e0b77c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.147647 Jun 23 20:16:00.726929 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 441/905] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:00 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:01.613497 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-cb7cb90c-edc9-456a-84bf-abdc4c65e447 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:01.614176 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-cb7cb90c-edc9-456a-84bf-abdc4c65e447 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:01.621625 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cb7cb90c-edc9-456a-84bf-abdc4c65e447 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:01.622074 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cb7cb90c-edc9-456a-84bf-abdc4c65e447 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:01.622829 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cb7cb90c-edc9-456a-84bf-abdc4c65e447 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:01.623267 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-cb7cb90c-edc9-456a-84bf-abdc4c65e447 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:01.742965 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2bf1195f-fed5-41fb-bd34-5ab9528de919 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:01.743511 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2bf1195f-fed5-41fb-bd34-5ab9528de919 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:01.749603 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2bf1195f-fed5-41fb-bd34-5ab9528de919 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:01.750049 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2bf1195f-fed5-41fb-bd34-5ab9528de919 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:01.750875 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2bf1195f-fed5-41fb-bd34-5ab9528de919 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:01.751332 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2bf1195f-fed5-41fb-bd34-5ab9528de919 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:01.753430 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-cb7cb90c-edc9-456a-84bf-abdc4c65e447 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:01.761870 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-cb7cb90c-edc9-456a-84bf-abdc4c65e447 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1578 microversion: 2.1 time: 0.152557 Jun 23 20:16:01.762441 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 465/906] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:01 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:01.890370 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2bf1195f-fed5-41fb-bd34-5ab9528de919 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:01.899054 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2bf1195f-fed5-41fb-bd34-5ab9528de919 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.159990 Jun 23 20:16:01.899719 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 442/907] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:01 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:02.778840 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-71d2f36f-7743-48fb-b7d9-2ef4d7b1ea4e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:02.779438 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-71d2f36f-7743-48fb-b7d9-2ef4d7b1ea4e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:02.781379 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:02.782115 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=8 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:02.787282 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71d2f36f-7743-48fb-b7d9-2ef4d7b1ea4e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:02.788255 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71d2f36f-7743-48fb-b7d9-2ef4d7b1ea4e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:02.793906 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71d2f36f-7743-48fb-b7d9-2ef4d7b1ea4e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:02.793906 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-71d2f36f-7743-48fb-b7d9-2ef4d7b1ea4e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:02.917414 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f5e8a97a-b371-4eca-8583-e671402a0fdb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:02.918096 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f5e8a97a-b371-4eca-8583-e671402a0fdb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:02.921897 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-71d2f36f-7743-48fb-b7d9-2ef4d7b1ea4e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:02.924790 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5e8a97a-b371-4eca-8583-e671402a0fdb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:02.925417 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5e8a97a-b371-4eca-8583-e671402a0fdb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:02.926697 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5e8a97a-b371-4eca-8583-e671402a0fdb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:02.927386 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5e8a97a-b371-4eca-8583-e671402a0fdb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:02.928482 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:02.935865 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-71d2f36f-7743-48fb-b7d9-2ef4d7b1ea4e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1578 microversion: 2.1 time: 0.159966 Jun 23 20:16:02.936553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 466/908] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:02 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:03.066730 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f5e8a97a-b371-4eca-8583-e671402a0fdb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:03.075075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f5e8a97a-b371-4eca-8583-e671402a0fdb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.162213 Jun 23 20:16:03.075946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 443/909] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:02 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:03.614198 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-2ee08830-ff58-4f12-b980-23dd0606dda2 req-ef769722-97d9-46ec-9bf1-2bba8fb1db71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf4d745-73cd-458d-9aa6-cef42480b9f2", "name": "network-vif-plugged", "status": "completed", "tag": "20228e09-3cd8-4ebb-a57a-0b23971f8745"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:03.627325 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-2ee08830-ff58-4f12-b980-23dd0606dda2 req-ef769722-97d9-46ec-9bf1-2bba8fb1db71 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:03.627994 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-2ee08830-ff58-4f12-b980-23dd0606dda2 req-ef769722-97d9-46ec-9bf1-2bba8fb1db71 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:03.639174 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-2ee08830-ff58-4f12-b980-23dd0606dda2 req-ef769722-97d9-46ec-9bf1-2bba8fb1db71 service nova] Creating event network-vif-plugged:20228e09-3cd8-4ebb-a57a-0b23971f8745 for instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 on hv-cinder-84727 Jun 23 20:16:03.643923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-2ee08830-ff58-4f12-b980-23dd0606dda2 req-ef769722-97d9-46ec-9bf1-2bba8fb1db71 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033803 Jun 23 20:16:03.644530 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 467/910] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:16:03.953134 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c28cf7e0-f447-476b-8ea9-5529a71c815f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:03.953840 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c28cf7e0-f447-476b-8ea9-5529a71c815f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:03.961097 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c28cf7e0-f447-476b-8ea9-5529a71c815f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:03.962529 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c28cf7e0-f447-476b-8ea9-5529a71c815f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:03.962529 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c28cf7e0-f447-476b-8ea9-5529a71c815f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:03.962774 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c28cf7e0-f447-476b-8ea9-5529a71c815f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:04.093689 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7c03a81f-dd10-4378-a6ec-4c63c4f4a3e3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:04.094526 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7c03a81f-dd10-4378-a6ec-4c63c4f4a3e3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:04.100966 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c28cf7e0-f447-476b-8ea9-5529a71c815f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:04.103103 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7c03a81f-dd10-4378-a6ec-4c63c4f4a3e3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:04.103481 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7c03a81f-dd10-4378-a6ec-4c63c4f4a3e3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:04.104285 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7c03a81f-dd10-4378-a6ec-4c63c4f4a3e3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:04.104743 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7c03a81f-dd10-4378-a6ec-4c63c4f4a3e3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:04.109807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c28cf7e0-f447-476b-8ea9-5529a71c815f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1578 microversion: 2.1 time: 0.160466 Jun 23 20:16:04.110560 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 444/911] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:03 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:04.245188 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7c03a81f-dd10-4378-a6ec-4c63c4f4a3e3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:04.255649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7c03a81f-dd10-4378-a6ec-4c63c4f4a3e3 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.166666 Jun 23 20:16:04.256208 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 468/912] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:04 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:05.126503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cbc6aae8-7ebe-40a4-9871-b326a76a78c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:05.127796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cbc6aae8-7ebe-40a4-9871-b326a76a78c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:05.130179 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:05.135156 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbc6aae8-7ebe-40a4-9871-b326a76a78c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:05.135600 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbc6aae8-7ebe-40a4-9871-b326a76a78c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:05.136423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbc6aae8-7ebe-40a4-9871-b326a76a78c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:05.136883 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-cbc6aae8-7ebe-40a4-9871-b326a76a78c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:05.274540 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7402d0c3-f2d7-4afc-88b7-00ee2169c1c6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:05.275156 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7402d0c3-f2d7-4afc-88b7-00ee2169c1c6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:05.278083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cbc6aae8-7ebe-40a4-9871-b326a76a78c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:05.282449 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7402d0c3-f2d7-4afc-88b7-00ee2169c1c6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:05.282896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7402d0c3-f2d7-4afc-88b7-00ee2169c1c6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:05.283657 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7402d0c3-f2d7-4afc-88b7-00ee2169c1c6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:05.284088 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7402d0c3-f2d7-4afc-88b7-00ee2169c1c6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:05.285989 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cbc6aae8-7ebe-40a4-9871-b326a76a78c4 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1578 microversion: 2.1 time: 0.163317 Jun 23 20:16:05.286660 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 445/913] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:05 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:05.420007 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7402d0c3-f2d7-4afc-88b7-00ee2169c1c6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:05.427672 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7402d0c3-f2d7-4afc-88b7-00ee2169c1c6 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.158162 Jun 23 20:16:05.428602 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 469/914] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:05 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:05.662101 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-cd89c23b-a3fe-4597-b3de-5446232384a3 req-f3f22660-3db1-4f7c-8d80-bf0b07bee995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a12f15d-0c87-4413-a893-463700ea1e11", "name": "network-vif-unplugged", "status": "completed", "tag": "a261f993-dd66-47dc-9b31-a51d223f5302"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:05.673801 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cd89c23b-a3fe-4597-b3de-5446232384a3 req-f3f22660-3db1-4f7c-8d80-bf0b07bee995 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:05.674293 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-cd89c23b-a3fe-4597-b3de-5446232384a3 req-f3f22660-3db1-4f7c-8d80-bf0b07bee995 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:05.678011 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:05.687600 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-cd89c23b-a3fe-4597-b3de-5446232384a3 req-f3f22660-3db1-4f7c-8d80-bf0b07bee995 service nova] Creating event network-vif-unplugged:a261f993-dd66-47dc-9b31-a51d223f5302 for instance 6a12f15d-0c87-4413-a893-463700ea1e11 on hv-cinder-84727 Jun 23 20:16:05.692849 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-cd89c23b-a3fe-4597-b3de-5446232384a3 req-f3f22660-3db1-4f7c-8d80-bf0b07bee995 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034364 Jun 23 20:16:05.693454 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 446/915] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:06.306832 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-99495576-487e-4077-9b9d-76a6980e31a1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:06.306832 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-99495576-487e-4077-9b9d-76a6980e31a1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:06.312779 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99495576-487e-4077-9b9d-76a6980e31a1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:06.313461 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99495576-487e-4077-9b9d-76a6980e31a1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:06.314390 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99495576-487e-4077-9b9d-76a6980e31a1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:06.314974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-99495576-487e-4077-9b9d-76a6980e31a1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:06.361631 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-73ef677d-1b90-4ad5-91a6-48e4e86023dc req-3aa65d2d-f6fa-45e9-b900-f460c1c88998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a12f15d-0c87-4413-a893-463700ea1e11", "name": "network-vif-deleted", "tag": "a261f993-dd66-47dc-9b31-a51d223f5302"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:06.371521 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-73ef677d-1b90-4ad5-91a6-48e4e86023dc req-3aa65d2d-f6fa-45e9-b900-f460c1c88998 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:06.372052 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-73ef677d-1b90-4ad5-91a6-48e4e86023dc req-3aa65d2d-f6fa-45e9-b900-f460c1c88998 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:06.382929 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-73ef677d-1b90-4ad5-91a6-48e4e86023dc req-3aa65d2d-f6fa-45e9-b900-f460c1c88998 service nova] Creating event network-vif-deleted:a261f993-dd66-47dc-9b31-a51d223f5302 for instance 6a12f15d-0c87-4413-a893-463700ea1e11 on hv-cinder-84727 Jun 23 20:16:06.386755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-99495576-487e-4077-9b9d-76a6980e31a1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:06.387783 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-73ef677d-1b90-4ad5-91a6-48e4e86023dc req-3aa65d2d-f6fa-45e9-b900-f460c1c88998 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030385 Jun 23 20:16:06.388374 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 447/916] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:06.394868 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-99495576-487e-4077-9b9d-76a6980e31a1 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1391 microversion: 2.1 time: 0.095370 Jun 23 20:16:06.395515 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 470/917] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:06 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1391 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:06.445469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7b94954a-6e8f-48d8-8b96-4141bd5ce6fb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:06.446264 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7b94954a-6e8f-48d8-8b96-4141bd5ce6fb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:06.452921 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b94954a-6e8f-48d8-8b96-4141bd5ce6fb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:06.453378 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b94954a-6e8f-48d8-8b96-4141bd5ce6fb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:06.455919 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b94954a-6e8f-48d8-8b96-4141bd5ce6fb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:06.455919 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b94954a-6e8f-48d8-8b96-4141bd5ce6fb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:06.587888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7b94954a-6e8f-48d8-8b96-4141bd5ce6fb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:06.598423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7b94954a-6e8f-48d8-8b96-4141bd5ce6fb tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.154693 Jun 23 20:16:06.598423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 448/918] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:06 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:07.411616 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-133f826f-17c8-4c21-a195-737aa8ab148f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:07.412216 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-133f826f-17c8-4c21-a195-737aa8ab148f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:07.418695 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-133f826f-17c8-4c21-a195-737aa8ab148f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:07.419141 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-133f826f-17c8-4c21-a195-737aa8ab148f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:07.419882 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-133f826f-17c8-4c21-a195-737aa8ab148f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:07.420331 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-133f826f-17c8-4c21-a195-737aa8ab148f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:07.486453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-133f826f-17c8-4c21-a195-737aa8ab148f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:07.495283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-133f826f-17c8-4c21-a195-737aa8ab148f tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 200 len: 1224 microversion: 2.1 time: 0.087459 Jun 23 20:16:07.496019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 471/919] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:07 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:07.614089 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4ff80ad8-0331-422d-b206-5f9adb040a2a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:07.614694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4ff80ad8-0331-422d-b206-5f9adb040a2a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:07.622088 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ff80ad8-0331-422d-b206-5f9adb040a2a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:07.622535 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ff80ad8-0331-422d-b206-5f9adb040a2a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:07.623297 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ff80ad8-0331-422d-b206-5f9adb040a2a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:07.626910 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ff80ad8-0331-422d-b206-5f9adb040a2a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:07.752421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4ff80ad8-0331-422d-b206-5f9adb040a2a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:07.759643 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4ff80ad8-0331-422d-b206-5f9adb040a2a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1363 microversion: 2.1 time: 0.149865 Jun 23 20:16:07.760202 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 449/920] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:07 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:07.994243 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1435713", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "networks": [{"uuid": "93615a59-0936-480e-a559-d91a2775b59b"}]}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:08.045658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] validate_networks() for [('93615a59-0936-480e-a559-d91a2775b59b', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:16:08.426968 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:16:08.427595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:16:08.427844 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:16:08.428496 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:16:08.429051 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:16:08.443178 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:08.443615 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:08.444968 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:08.445395 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:08.467242 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Getting quotas for project eccb032b11e045fdbb42238762eada05. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:16:08.472072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Getting quotas for user 1b02048ea85d46889e86bb8d073bf456 and project eccb032b11e045fdbb42238762eada05. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:16:08.488179 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:16:08.490465 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:16:08.512259 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:08.512892 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 6a12f15d-0c87-4413-a893-463700ea1e11] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:08.519238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:08.519691 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:08.520495 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:08.520933 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:08.535936 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] HTTP exception thrown: Instance 6a12f15d-0c87-4413-a893-463700ea1e11 could not be found. Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Request method failure captured: Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 HTTP/1.1 Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMghZPttoRRCadsrbFyhVr8Xt9PBJ4ob6CN7M79Wnz7hPCr_NB6A2cqC7wFVIN1bqiGBRO6dauPbjFgGlaBPX0rFtxl9sOM9A1AgSmjACOKkKBvCai7MjZhG8TgIo0U_HTbcR6kxrmT-aYoWedMTiL6r0Z4sRUr7eKhOCN2owatjD4I Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:16:08.537688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_edb569a8b39a437ea8be940df098268c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/edb569a8b39a437ea8be940df098268c"}]}] Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: eafea4329d6243459dd3a6add1e91a2e Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance 6a12f15d-0c87-4413-a893-463700ea1e11 could not be found. Jun 23 20:16:08.539451 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '6a12f15d-0c87-4413-a893-463700ea1e11'} Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a12f15d-0c87-4413-a893-463700ea1e11 could not be found. Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:16:08.540575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a12f15d-0c87-4413-a893-463700ea1e11 could not be found. Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a12f15d-0c87-4413-a893-463700ea1e11 could not be found. Jun 23 20:16:08.542108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:08.543485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Returning 404 to user: Instance 6a12f15d-0c87-4413-a893-463700ea1e11 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:16:08.543485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2e9503ce-7b1d-4616-8f00-af820d72eafb tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11" status: 404 len: 111 microversion: 2.1 time: 0.031524 Jun 23 20:16:08.543485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 450/921] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:08 2022] GET /compute/v2.1/servers/6a12f15d-0c87-4413-a893-463700ea1e11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 20:16:08.599545 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f628e4d9-1cb3-4490-b0a2-6836f3650fb5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609754 Jun 23 20:16:08.600162 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 472/922] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:16:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:16:08.610514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c3841ea0-c8aa-4410-a15b-d87b755f2355 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:08.611148 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c3841ea0-c8aa-4410-a15b-d87b755f2355 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:08.667359 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c3841ea0-c8aa-4410-a15b-d87b755f2355 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:08.674565 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c3841ea0-c8aa-4410-a15b-d87b755f2355 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1216 microversion: 2.1 time: 0.068075 Jun 23 20:16:08.674981 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 451/923] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:08 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:08.779021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-21d5dc12-0fdb-4ddb-8850-adf409c1c656 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:08.780839 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-21d5dc12-0fdb-4ddb-8850-adf409c1c656 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:08.787751 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-21d5dc12-0fdb-4ddb-8850-adf409c1c656 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:08.789996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-21d5dc12-0fdb-4ddb-8850-adf409c1c656 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:08.789996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-21d5dc12-0fdb-4ddb-8850-adf409c1c656 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:08.789996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-21d5dc12-0fdb-4ddb-8850-adf409c1c656 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:08.928938 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-21d5dc12-0fdb-4ddb-8850-adf409c1c656 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:08.936373 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-21d5dc12-0fdb-4ddb-8850-adf409c1c656 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1548 microversion: 2.1 time: 0.164063 Jun 23 20:16:08.936930 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 473/924] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:08 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:08.954857 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9e2c9c48-2302-4ad9-930b-86250c900821 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:08.955395 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9e2c9c48-2302-4ad9-930b-86250c900821 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:08.962566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9e2c9c48-2302-4ad9-930b-86250c900821 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:08.963059 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9e2c9c48-2302-4ad9-930b-86250c900821 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:08.963818 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9e2c9c48-2302-4ad9-930b-86250c900821 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:08.964252 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9e2c9c48-2302-4ad9-930b-86250c900821 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:09.041549 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9e2c9c48-2302-4ad9-930b-86250c900821 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090894 Jun 23 20:16:09.042150 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 452/925] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 23 20:16:08 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:16:09.690900 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b1592933-3f97-4466-ab2d-8397508c73ef tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:09.691633 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b1592933-3f97-4466-ab2d-8397508c73ef tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:09.698194 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1592933-3f97-4466-ab2d-8397508c73ef tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:09.698641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1592933-3f97-4466-ab2d-8397508c73ef tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:09.699388 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1592933-3f97-4466-ab2d-8397508c73ef tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:09.699860 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1592933-3f97-4466-ab2d-8397508c73ef tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:09.793623 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b1592933-3f97-4466-ab2d-8397508c73ef tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:09.803102 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b1592933-3f97-4466-ab2d-8397508c73ef tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1220 microversion: 2.1 time: 0.115942 Jun 23 20:16:09.803677 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 474/926] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:09 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:10.045514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-0956cbd8-62a5-4153-96ab-27a33bf2c9ef req-451aa40f-129d-4c76-b44e-40d8ab0567ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf4d745-73cd-458d-9aa6-cef42480b9f2", "tag": "20228e09-3cd8-4ebb-a57a-0b23971f8745"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:10.053768 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-0956cbd8-62a5-4153-96ab-27a33bf2c9ef req-451aa40f-129d-4c76-b44e-40d8ab0567ce service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:10.054215 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-0956cbd8-62a5-4153-96ab-27a33bf2c9ef req-451aa40f-129d-4c76-b44e-40d8ab0567ce service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:10.065637 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-0956cbd8-62a5-4153-96ab-27a33bf2c9ef req-451aa40f-129d-4c76-b44e-40d8ab0567ce service nova] Creating event network-changed:20228e09-3cd8-4ebb-a57a-0b23971f8745 for instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 on hv-cinder-84727 Jun 23 20:16:10.070938 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-0956cbd8-62a5-4153-96ab-27a33bf2c9ef req-451aa40f-129d-4c76-b44e-40d8ab0567ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029613 Jun 23 20:16:10.072055 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 453/927] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:10.821828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1c4907a0-81ab-489a-bab6-d39194259e87 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:10.823071 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1c4907a0-81ab-489a-bab6-d39194259e87 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:10.829733 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1c4907a0-81ab-489a-bab6-d39194259e87 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:10.830176 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1c4907a0-81ab-489a-bab6-d39194259e87 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:10.830941 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1c4907a0-81ab-489a-bab6-d39194259e87 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:10.831370 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1c4907a0-81ab-489a-bab6-d39194259e87 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:10.910073 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1c4907a0-81ab-489a-bab6-d39194259e87 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:10.918116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1c4907a0-81ab-489a-bab6-d39194259e87 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1268 microversion: 2.1 time: 0.100419 Jun 23 20:16:10.918681 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 475/928] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:10 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1268 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:11.939649 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-43dbe78c-de1d-463d-8c6c-95373873734b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:11.941029 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-43dbe78c-de1d-463d-8c6c-95373873734b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:11.948897 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43dbe78c-de1d-463d-8c6c-95373873734b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:11.949826 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43dbe78c-de1d-463d-8c6c-95373873734b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:11.950926 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43dbe78c-de1d-463d-8c6c-95373873734b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:11.951435 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-43dbe78c-de1d-463d-8c6c-95373873734b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:12.162014 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-43dbe78c-de1d-463d-8c6c-95373873734b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:12.172130 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-43dbe78c-de1d-463d-8c6c-95373873734b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1316 microversion: 2.1 time: 0.237002 Jun 23 20:16:12.173116 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 454/929] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:11 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:12.190276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ff28a3cb-4adb-4d88-bbb9-3fab8e963102 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:12.200363 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ff28a3cb-4adb-4d88-bbb9-3fab8e963102 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:12.201186 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-740fb9d9-2248-4f33-9689-366b3e14c0df req-5c4b4fde-f45d-4d79-90f2-a6c53fdc8e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d760fb45-e1c6-4ac7-9d84-a507fd45b396", "tag": "0b827b10-c629-4517-9e99-ed82b161fe9d"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:12.203424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-740fb9d9-2248-4f33-9689-366b3e14c0df req-5c4b4fde-f45d-4d79-90f2-a6c53fdc8e93 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:12.204063 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-740fb9d9-2248-4f33-9689-366b3e14c0df req-5c4b4fde-f45d-4d79-90f2-a6c53fdc8e93 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:12.215819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff28a3cb-4adb-4d88-bbb9-3fab8e963102 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:12.216786 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff28a3cb-4adb-4d88-bbb9-3fab8e963102 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:12.217715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff28a3cb-4adb-4d88-bbb9-3fab8e963102 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:12.218304 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-ff28a3cb-4adb-4d88-bbb9-3fab8e963102 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:12.223329 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-740fb9d9-2248-4f33-9689-366b3e14c0df req-5c4b4fde-f45d-4d79-90f2-a6c53fdc8e93 service nova] Creating event network-changed:0b827b10-c629-4517-9e99-ed82b161fe9d for instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 on hv-cinder-84727 Jun 23 20:16:12.231183 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-740fb9d9-2248-4f33-9689-366b3e14c0df req-5c4b4fde-f45d-4d79-90f2-a6c53fdc8e93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042746 Jun 23 20:16:12.232503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 455/930] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:16:12.252936 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-ff28a3cb-4adb-4d88-bbb9-3fab8e963102 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:16:12.522859 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ff28a3cb-4adb-4d88-bbb9-3fab8e963102 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 204 len: 0 microversion: 2.1 time: 0.336532 Jun 23 20:16:12.523819 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 476/931] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:16:12 2022] DELETE /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:16:12.533841 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9638142b-4426-4394-bbcf-74dadfd163a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:12.534800 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9638142b-4426-4394-bbcf-74dadfd163a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:12.543193 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9638142b-4426-4394-bbcf-74dadfd163a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:12.543687 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9638142b-4426-4394-bbcf-74dadfd163a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:12.544516 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9638142b-4426-4394-bbcf-74dadfd163a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:12.545394 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9638142b-4426-4394-bbcf-74dadfd163a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:12.822667 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-9638142b-4426-4394-bbcf-74dadfd163a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:12.831229 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9638142b-4426-4394-bbcf-74dadfd163a6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1577 microversion: 2.1 time: 0.302582 Jun 23 20:16:12.831800 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 456/932] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:12 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1577 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:13.152060 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-b1d92cb9-7829-492c-9186-350e84e91ac6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:13.152790 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-b1d92cb9-7829-492c-9186-350e84e91ac6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:13.159067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1d92cb9-7829-492c-9186-350e84e91ac6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:13.159718 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1d92cb9-7829-492c-9186-350e84e91ac6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:13.160529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1d92cb9-7829-492c-9186-350e84e91ac6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:13.161308 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-b1d92cb9-7829-492c-9186-350e84e91ac6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:13.189995 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b2e49e73-0fce-49fc-af09-377cd334a37f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:13.190592 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b2e49e73-0fce-49fc-af09-377cd334a37f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:13.198337 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b2e49e73-0fce-49fc-af09-377cd334a37f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:13.199065 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b2e49e73-0fce-49fc-af09-377cd334a37f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:13.200006 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b2e49e73-0fce-49fc-af09-377cd334a37f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:13.200481 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b2e49e73-0fce-49fc-af09-377cd334a37f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:13.439112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-b1d92cb9-7829-492c-9186-350e84e91ac6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:13.447728 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-b1d92cb9-7829-492c-9186-350e84e91ac6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1592 microversion: 2.1 time: 0.305580 Jun 23 20:16:13.448265 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 477/933] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:13 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1592 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:13.458843 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b2e49e73-0fce-49fc-af09-377cd334a37f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:13.459279 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-00ef3712-7834-4097-8f3e-4e4d546bffc6 req-ef093478-8984-4bf8-a52d-ba359987b5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de3437f7-7812-42da-97dc-6bb6b35fc998", "tag": "e2f74ae4-0534-4d6c-9e6d-45568ca17ad6"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:13.459378 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b2e49e73-0fce-49fc-af09-377cd334a37f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1316 microversion: 2.1 time: 0.272339 Jun 23 20:16:13.460734 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 457/934] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:13 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:13.460850 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-00ef3712-7834-4097-8f3e-4e4d546bffc6 req-ef093478-8984-4bf8-a52d-ba359987b5ee service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:13.461219 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-00ef3712-7834-4097-8f3e-4e4d546bffc6 req-ef093478-8984-4bf8-a52d-ba359987b5ee service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:13.473044 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-00ef3712-7834-4097-8f3e-4e4d546bffc6 req-ef093478-8984-4bf8-a52d-ba359987b5ee service nova] Creating event network-changed:e2f74ae4-0534-4d6c-9e6d-45568ca17ad6 for instance de3437f7-7812-42da-97dc-6bb6b35fc998 on hv-cinder-84727 Jun 23 20:16:13.477799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-00ef3712-7834-4097-8f3e-4e4d546bffc6 req-ef093478-8984-4bf8-a52d-ba359987b5ee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028430 Jun 23 20:16:13.478377 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 478/935] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:13.848987 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e52bd713-6edf-4ea9-b294-84077c9ee934 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:13.849746 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e52bd713-6edf-4ea9-b294-84077c9ee934 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:13.856181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e52bd713-6edf-4ea9-b294-84077c9ee934 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:13.856742 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e52bd713-6edf-4ea9-b294-84077c9ee934 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:13.857501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e52bd713-6edf-4ea9-b294-84077c9ee934 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:13.857939 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e52bd713-6edf-4ea9-b294-84077c9ee934 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:13.988133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e52bd713-6edf-4ea9-b294-84077c9ee934 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:13.996734 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e52bd713-6edf-4ea9-b294-84077c9ee934 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1577 microversion: 2.1 time: 0.151506 Jun 23 20:16:14.004707 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 458/936] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:13 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:14.476587 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-45c9c0b4-e45a-4668-ae51-c0b5898e63d2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:14.477373 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-45c9c0b4-e45a-4668-ae51-c0b5898e63d2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:14.484394 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45c9c0b4-e45a-4668-ae51-c0b5898e63d2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:14.485018 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45c9c0b4-e45a-4668-ae51-c0b5898e63d2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:14.486154 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45c9c0b4-e45a-4668-ae51-c0b5898e63d2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:14.486688 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45c9c0b4-e45a-4668-ae51-c0b5898e63d2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:15.016501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ae3fee5f-5896-40ec-8cd6-28e2e0a78cbc tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:15.017335 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ae3fee5f-5896-40ec-8cd6-28e2e0a78cbc tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:15.024370 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-45c9c0b4-e45a-4668-ae51-c0b5898e63d2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:15.025039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ae3fee5f-5896-40ec-8cd6-28e2e0a78cbc tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:15.026231 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ae3fee5f-5896-40ec-8cd6-28e2e0a78cbc tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:15.027315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ae3fee5f-5896-40ec-8cd6-28e2e0a78cbc tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:15.027863 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ae3fee5f-5896-40ec-8cd6-28e2e0a78cbc tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:15.032880 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-45c9c0b4-e45a-4668-ae51-c0b5898e63d2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1316 microversion: 2.1 time: 0.561380 Jun 23 20:16:15.043940 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 479/937] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:14 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1316 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:15.246139 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ae3fee5f-5896-40ec-8cd6-28e2e0a78cbc tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:15.254097 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ae3fee5f-5896-40ec-8cd6-28e2e0a78cbc tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1577 microversion: 2.1 time: 0.243537 Jun 23 20:16:15.254663 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 459/938] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:15 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:15.765246 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-d8b734f2-cf9d-497d-b72d-427744953f2c req-56203b6b-1a1c-487b-ae9b-14d516047c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d760fb45-e1c6-4ac7-9d84-a507fd45b396", "name": "network-vif-deleted", "tag": "0b827b10-c629-4517-9e99-ed82b161fe9d"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:15.776710 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-d8b734f2-cf9d-497d-b72d-427744953f2c req-56203b6b-1a1c-487b-ae9b-14d516047c94 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:15.777254 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-d8b734f2-cf9d-497d-b72d-427744953f2c req-56203b6b-1a1c-487b-ae9b-14d516047c94 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:15.792783 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-d8b734f2-cf9d-497d-b72d-427744953f2c req-56203b6b-1a1c-487b-ae9b-14d516047c94 service nova] Creating event network-vif-deleted:0b827b10-c629-4517-9e99-ed82b161fe9d for instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 on hv-cinder-84727 Jun 23 20:16:15.797866 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-d8b734f2-cf9d-497d-b72d-427744953f2c req-56203b6b-1a1c-487b-ae9b-14d516047c94 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037967 Jun 23 20:16:15.798462 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 480/939] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:16.052509 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-88a8b3e1-d89b-481b-86dc-e713e5ecb89c tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:16.053777 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-88a8b3e1-d89b-481b-86dc-e713e5ecb89c tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:16.062083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-88a8b3e1-d89b-481b-86dc-e713e5ecb89c tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:16.062888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-88a8b3e1-d89b-481b-86dc-e713e5ecb89c tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:16.063909 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-88a8b3e1-d89b-481b-86dc-e713e5ecb89c tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:16.064658 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-88a8b3e1-d89b-481b-86dc-e713e5ecb89c tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:16.235684 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-88a8b3e1-d89b-481b-86dc-e713e5ecb89c tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:16.243966 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-88a8b3e1-d89b-481b-86dc-e713e5ecb89c tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1316 microversion: 2.1 time: 0.197732 Jun 23 20:16:16.244569 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 460/940] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:16 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:16.271688 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5f08a0bb-1d28-4cfd-8e13-59042c26af1b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:16.272966 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5f08a0bb-1d28-4cfd-8e13-59042c26af1b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:16.279508 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5f08a0bb-1d28-4cfd-8e13-59042c26af1b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:16.279962 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5f08a0bb-1d28-4cfd-8e13-59042c26af1b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:16.283669 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5f08a0bb-1d28-4cfd-8e13-59042c26af1b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:16.283669 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5f08a0bb-1d28-4cfd-8e13-59042c26af1b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:16.345402 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5f08a0bb-1d28-4cfd-8e13-59042c26af1b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:16.353060 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5f08a0bb-1d28-4cfd-8e13-59042c26af1b tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1224 microversion: 2.1 time: 0.085808 Jun 23 20:16:16.353626 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 481/941] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:16 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:17.261382 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-39805858-c20f-4e85-b6fa-2b55a1b088c0 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:17.265617 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-39805858-c20f-4e85-b6fa-2b55a1b088c0 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:17.268596 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39805858-c20f-4e85-b6fa-2b55a1b088c0 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:17.269045 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39805858-c20f-4e85-b6fa-2b55a1b088c0 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:17.269930 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39805858-c20f-4e85-b6fa-2b55a1b088c0 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:17.270366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39805858-c20f-4e85-b6fa-2b55a1b088c0 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:17.369702 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:17.371144 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:17.378445 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:17.378794 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:17.379876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:17.380352 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:17.415259 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:17.415711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:17.416152 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.objects.instance [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lazy-loading 'fault' on Instance uuid d760fb45-e1c6-4ac7-9d84-a507fd45b396 {{(pid=118346) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:16:17.467511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eafea4329d6243459dd3a6add1e91a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb569a8b39a437ea8be940df098268c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:17.471257 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-39805858-c20f-4e85-b6fa-2b55a1b088c0 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:17.476934 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fffde93b-eb9d-42b7-a513-94a6a039e0f6 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 200 len: 1229 microversion: 2.1 time: 0.111020 Jun 23 20:16:17.486543 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 482/942] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:17 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:17.486693 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-39805858-c20f-4e85-b6fa-2b55a1b088c0 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1316 microversion: 2.1 time: 0.221954 Jun 23 20:16:17.486693 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 461/943] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:17 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:17.812817 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-749a1c22-45e1-45ff-a069-8082689d364b req-7d96dfda-967b-48c5-8c0c-7fce25bbaf95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c6eafe-f596-4262-9487-4cd023a99823", "tag": "077883ce-f410-4855-8c89-e480ffa737bf"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:17.821405 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-749a1c22-45e1-45ff-a069-8082689d364b req-7d96dfda-967b-48c5-8c0c-7fce25bbaf95 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:17.828697 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-749a1c22-45e1-45ff-a069-8082689d364b req-7d96dfda-967b-48c5-8c0c-7fce25bbaf95 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:17.832201 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-749a1c22-45e1-45ff-a069-8082689d364b req-7d96dfda-967b-48c5-8c0c-7fce25bbaf95 service nova] Creating event network-changed:077883ce-f410-4855-8c89-e480ffa737bf for instance e9c6eafe-f596-4262-9487-4cd023a99823 on hv-cinder-84727 Jun 23 20:16:17.837262 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-749a1c22-45e1-45ff-a069-8082689d364b req-7d96dfda-967b-48c5-8c0c-7fce25bbaf95 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028064 Jun 23 20:16:17.837868 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 483/944] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:18.493829 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:18.494486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: d760fb45-e1c6-4ac7-9d84-a507fd45b396] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:18.494631 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:18.495469 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=6 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:18.499832 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8ee7a4dc-4470-4b9d-a8b4-37de596b27f4 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:18.500594 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8ee7a4dc-4470-4b9d-a8b4-37de596b27f4 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:18.500946 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:18.501403 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:18.502176 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:18.502820 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:18.507687 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8ee7a4dc-4470-4b9d-a8b4-37de596b27f4 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:18.508454 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8ee7a4dc-4470-4b9d-a8b4-37de596b27f4 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:18.509422 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8ee7a4dc-4470-4b9d-a8b4-37de596b27f4 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:18.509937 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8ee7a4dc-4470-4b9d-a8b4-37de596b27f4 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:18.518426 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] HTTP exception thrown: Instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 could not be found. Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Request method failure captured: Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 HTTP/1.1 Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMghZPttoRRCadsrbFyhVr8Xt9PBJ4ob6CN7M79Wnz7hPCr_NB6A2cqC7wFVIN1bqiGBRO6dauPbjFgGlaBPX0rFtxl9sOM9A1AgSmjACOKkKBvCai7MjZhG8TgIo0U_HTbcR6kxrmT-aYoWedMTiL6r0Z4sRUr7eKhOCN2owatjD4I Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:16:18.520128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_edb569a8b39a437ea8be940df098268c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/edb569a8b39a437ea8be940df098268c"}]}] Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: eafea4329d6243459dd3a6add1e91a2e Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 could not be found. Jun 23 20:16:18.521701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'd760fb45-e1c6-4ac7-9d84-a507fd45b396'} Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 could not be found. Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:16:18.522494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 could not be found. Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 could not be found. Jun 23 20:16:18.528706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:16:18.530129 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Returning 404 to user: Instance d760fb45-e1c6-4ac7-9d84-a507fd45b396 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:16:18.530129 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f06886bc-98bc-414a-9b3f-287cfc197662 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396" status: 404 len: 111 microversion: 2.1 time: 0.032341 Jun 23 20:16:18.530129 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 462/945] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:18 2022] GET /compute/v2.1/servers/d760fb45-e1c6-4ac7-9d84-a507fd45b396 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:16:18.755811 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8ee7a4dc-4470-4b9d-a8b4-37de596b27f4 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:18.760995 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:18.766284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8ee7a4dc-4470-4b9d-a8b4-37de596b27f4 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1316 microversion: 2.1 time: 0.274209 Jun 23 20:16:18.766957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 484/946] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:18 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:19.001712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1f41c68f-ebd6-4164-939f-f0edc5d99d8e tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1816725656"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:19.002245 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1f41c68f-ebd6-4164-939f-f0edc5d99d8e tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:19.004191 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:19.009074 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f41c68f-ebd6-4164-939f-f0edc5d99d8e tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.009524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f41c68f-ebd6-4164-939f-f0edc5d99d8e tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.010278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f41c68f-ebd6-4164-939f-f0edc5d99d8e tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.010713 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1f41c68f-ebd6-4164-939f-f0edc5d99d8e tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.206296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:19.206802 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:19.213828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.214281 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.215054 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.215685 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.215818 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.network.security_group_api [None req-1f41c68f-ebd6-4164-939f-f0edc5d99d8e tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Adding security group 9b454e09-45ae-4c25-aa5c-aa65450f4a48 to port 077883ce-f410-4855-8c89-e480ffa737bf Jun 23 20:16:19.230274 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] HTTP exception thrown: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Request method failure captured: Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: DELETE /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 HTTP/1.1 Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMghZPttoRRCadsrbFyhVr8Xt9PBJ4ob6CN7M79Wnz7hPCr_NB6A2cqC7wFVIN1bqiGBRO6dauPbjFgGlaBPX0rFtxl9sOM9A1AgSmjACOKkKBvCai7MjZhG8TgIo0U_HTbcR6kxrmT-aYoWedMTiL6r0Z4sRUr7eKhOCN2owatjD4I Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:16:19.232924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_edb569a8b39a437ea8be940df098268c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/edb569a8b39a437ea8be940df098268c"}]}] Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: eafea4329d6243459dd3a6add1e91a2e Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.234326 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '200f25e9-8d0e-42eb-91b6-57db370e99e1'} Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:16:19.235132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.236419 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.238481 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Returning 404 to user: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:16:19.239518 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-eb8cbd86-9b07-4ef8-9e67-7e2ca62ac460 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "DELETE /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 404 len: 111 microversion: 2.1 time: 0.037089 Jun 23 20:16:19.240245 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 485/947] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:16:19 2022] DELETE /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 20:16:19.248813 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:19.249355 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] [instance: 200f25e9-8d0e-42eb-91b6-57db370e99e1] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:19.255297 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.255749 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.256609 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.257065 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.270719 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] HTTP exception thrown: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Request method failure captured: Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 HTTP/1.1 Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMghZPttoRRCadsrbFyhVr8Xt9PBJ4ob6CN7M79Wnz7hPCr_NB6A2cqC7wFVIN1bqiGBRO6dauPbjFgGlaBPX0rFtxl9sOM9A1AgSmjACOKkKBvCai7MjZhG8TgIo0U_HTbcR6kxrmT-aYoWedMTiL6r0Z4sRUr7eKhOCN2owatjD4I Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:16:19.276873 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_edb569a8b39a437ea8be940df098268c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/edb569a8b39a437ea8be940df098268c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/edb569a8b39a437ea8be940df098268c"}]}] Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: edb569a8b39a437ea8be940df098268c Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-TestVolumeBootPattern-1600693803 Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: eafea4329d6243459dd3a6add1e91a2e Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-TestVolumeBootPattern-1600693803-project Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.278537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '200f25e9-8d0e-42eb-91b6-57db370e99e1'} Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:16:19.279455 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. Jun 23 20:16:19.280970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:16:19.282310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Returning 404 to user: Instance 200f25e9-8d0e-42eb-91b6-57db370e99e1 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:16:19.282310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-51c5dd3f-d0e7-40db-8cc5-e03189bc431e tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1" status: 404 len: 111 microversion: 2.1 time: 0.029049 Jun 23 20:16:19.282310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 486/948] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:19 2022] GET /compute/v2.1/servers/200f25e9-8d0e-42eb-91b6-57db370e99e1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 20:16:19.702389 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1f41c68f-ebd6-4164-939f-f0edc5d99d8e tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "POST /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/action" status: 202 len: 0 microversion: 2.1 time: 0.704281 Jun 23 20:16:19.706823 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 463/949] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:16:18 2022] POST /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/action => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:16:19.714288 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-575b2144-b453-4c9f-8e1d-3e0a9d9edfc5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:19.714903 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-575b2144-b453-4c9f-8e1d-3e0a9d9edfc5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:19.721909 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-807fd659-b250-4fb3-92b9-012da7b86791 req-3080aaf5-2f56-4375-900a-6a92712661ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c6eafe-f596-4262-9487-4cd023a99823", "tag": "077883ce-f410-4855-8c89-e480ffa737bf"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:19.731813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-575b2144-b453-4c9f-8e1d-3e0a9d9edfc5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.734667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-807fd659-b250-4fb3-92b9-012da7b86791 req-3080aaf5-2f56-4375-900a-6a92712661ee service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.735402 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-575b2144-b453-4c9f-8e1d-3e0a9d9edfc5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.736399 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-575b2144-b453-4c9f-8e1d-3e0a9d9edfc5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.737062 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-575b2144-b453-4c9f-8e1d-3e0a9d9edfc5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.737935 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-807fd659-b250-4fb3-92b9-012da7b86791 req-3080aaf5-2f56-4375-900a-6a92712661ee service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.756437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-807fd659-b250-4fb3-92b9-012da7b86791 req-3080aaf5-2f56-4375-900a-6a92712661ee service nova] Creating event network-changed:077883ce-f410-4855-8c89-e480ffa737bf for instance e9c6eafe-f596-4262-9487-4cd023a99823 on hv-cinder-84727 Jun 23 20:16:19.762695 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-807fd659-b250-4fb3-92b9-012da7b86791 req-3080aaf5-2f56-4375-900a-6a92712661ee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052865 Jun 23 20:16:19.763878 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 487/950] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:19.771205 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-f53eb24e-faa2-4c58-9bbe-85e5231969bc req-980e25ce-b845-453f-8b29-4ae835f8d5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3437f7-7812-42da-97dc-6bb6b35fc998", "name": "network-vif-plugged", "status": "completed", "tag": "e2f74ae4-0534-4d6c-9e6d-45568ca17ad6"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:19.784066 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-f53eb24e-faa2-4c58-9bbe-85e5231969bc req-980e25ce-b845-453f-8b29-4ae835f8d5ef service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.784638 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-f53eb24e-faa2-4c58-9bbe-85e5231969bc req-980e25ce-b845-453f-8b29-4ae835f8d5ef service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.796126 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-f53eb24e-faa2-4c58-9bbe-85e5231969bc req-980e25ce-b845-453f-8b29-4ae835f8d5ef service nova] Creating event network-vif-plugged:e2f74ae4-0534-4d6c-9e6d-45568ca17ad6 for instance de3437f7-7812-42da-97dc-6bb6b35fc998 on hv-cinder-84727 Jun 23 20:16:19.807988 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-f53eb24e-faa2-4c58-9bbe-85e5231969bc req-980e25ce-b845-453f-8b29-4ae835f8d5ef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042396 Jun 23 20:16:19.808614 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 488/951] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:19.819215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d95b7eba-cbaf-4e10-a43a-ddcf54a9880d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:19.820501 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d95b7eba-cbaf-4e10-a43a-ddcf54a9880d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:19.828970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d95b7eba-cbaf-4e10-a43a-ddcf54a9880d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.830013 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d95b7eba-cbaf-4e10-a43a-ddcf54a9880d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:19.833491 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d95b7eba-cbaf-4e10-a43a-ddcf54a9880d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:19.833491 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d95b7eba-cbaf-4e10-a43a-ddcf54a9880d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:20.097471 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-575b2144-b453-4c9f-8e1d-3e0a9d9edfc5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:20.110485 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-575b2144-b453-4c9f-8e1d-3e0a9d9edfc5 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1758 microversion: 2.1 time: 0.402400 Jun 23 20:16:20.111056 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 464/952] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:19 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1758 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:20.143576 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-d95b7eba-cbaf-4e10-a43a-ddcf54a9880d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:20.153527 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d95b7eba-cbaf-4e10-a43a-ddcf54a9880d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1316 microversion: 2.1 time: 0.341888 Jun 23 20:16:20.162610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 489/953] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:19 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:20.772358 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b00e5e79-93ee-4663-af92-d8a67d351c66 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] Calling method '.version_select at 0x7f90d9ef7a60>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:20.848930 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b00e5e79-93ee-4663-af92-d8a67d351c66 tempest-TestVolumeBootPattern-1600693803 tempest-TestVolumeBootPattern-1600693803-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-841892012" status: 202 len: 0 microversion: 2.1 time: 0.080687 Jun 23 20:16:20.849504 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 465/954] 10.222.0.44 () {58 vars in 1259 bytes} [Thu Jun 23 20:16:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-841892012 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:16:21.170866 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-dd6e33b0-3d97-44a5-8fc5-6a37713d5c53 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:21.171445 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-dd6e33b0-3d97-44a5-8fc5-6a37713d5c53 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:21.178498 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd6e33b0-3d97-44a5-8fc5-6a37713d5c53 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:21.179763 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd6e33b0-3d97-44a5-8fc5-6a37713d5c53 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:21.180595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd6e33b0-3d97-44a5-8fc5-6a37713d5c53 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:21.181218 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd6e33b0-3d97-44a5-8fc5-6a37713d5c53 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:21.622098 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-dd6e33b0-3d97-44a5-8fc5-6a37713d5c53 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:21.629557 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-dd6e33b0-3d97-44a5-8fc5-6a37713d5c53 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1316 microversion: 2.1 time: 0.462916 Jun 23 20:16:21.631165 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 490/955] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:21 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:22.647542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6b460c2d-ff2b-4a4e-8d1a-58cde19c0a47 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:22.648283 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6b460c2d-ff2b-4a4e-8d1a-58cde19c0a47 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:22.655209 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b460c2d-ff2b-4a4e-8d1a-58cde19c0a47 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:22.655660 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b460c2d-ff2b-4a4e-8d1a-58cde19c0a47 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:22.656450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b460c2d-ff2b-4a4e-8d1a-58cde19c0a47 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:22.656891 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b460c2d-ff2b-4a4e-8d1a-58cde19c0a47 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:22.844010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6b460c2d-ff2b-4a4e-8d1a-58cde19c0a47 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:22.852828 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6b460c2d-ff2b-4a4e-8d1a-58cde19c0a47 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1505 microversion: 2.1 time: 0.209624 Jun 23 20:16:22.853379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 466/956] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:22 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:32.137359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a90547f6-759f-4eaf-82e0-966c1dad834a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:32.138219 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a90547f6-759f-4eaf-82e0-966c1dad834a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:32.140908 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:32.141574 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=20 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:32.146267 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a90547f6-759f-4eaf-82e0-966c1dad834a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:32.146713 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a90547f6-759f-4eaf-82e0-966c1dad834a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:32.151537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a90547f6-759f-4eaf-82e0-966c1dad834a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:32.151537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a90547f6-759f-4eaf-82e0-966c1dad834a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:32.348886 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a90547f6-759f-4eaf-82e0-966c1dad834a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "POST /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/action" status: 202 len: 0 microversion: 2.1 time: 0.215255 Jun 23 20:16:32.349981 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 491/957] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:16:32 2022] POST /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:16:32.358337 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-03eacfcf-3a85-445c-944e-7c0d08d8b112 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:32.358978 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-03eacfcf-3a85-445c-944e-7c0d08d8b112 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:32.362584 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:32.366105 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03eacfcf-3a85-445c-944e-7c0d08d8b112 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:32.366554 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03eacfcf-3a85-445c-944e-7c0d08d8b112 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:32.367323 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03eacfcf-3a85-445c-944e-7c0d08d8b112 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:32.367755 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-03eacfcf-3a85-445c-944e-7c0d08d8b112 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:32.529261 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-03eacfcf-3a85-445c-944e-7c0d08d8b112 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:32.537583 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-03eacfcf-3a85-445c-944e-7c0d08d8b112 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1750 microversion: 2.1 time: 0.183108 Jun 23 20:16:32.538148 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 467/958] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:32 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:33.556809 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e45e6ac1-4c35-41f3-a0b8-53e0642c924f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:33.557569 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e45e6ac1-4c35-41f3-a0b8-53e0642c924f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:33.563920 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e45e6ac1-4c35-41f3-a0b8-53e0642c924f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:33.564400 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e45e6ac1-4c35-41f3-a0b8-53e0642c924f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:33.565157 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e45e6ac1-4c35-41f3-a0b8-53e0642c924f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:33.565589 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e45e6ac1-4c35-41f3-a0b8-53e0642c924f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:33.708830 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e45e6ac1-4c35-41f3-a0b8-53e0642c924f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:33.717868 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e45e6ac1-4c35-41f3-a0b8-53e0642c924f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.166512 Jun 23 20:16:33.718416 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 492/959] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:33 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:34.735759 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e8621641-eda6-45cd-9a54-3367bdc23e9a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:34.736394 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e8621641-eda6-45cd-9a54-3367bdc23e9a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:34.743490 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e8621641-eda6-45cd-9a54-3367bdc23e9a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:34.743940 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e8621641-eda6-45cd-9a54-3367bdc23e9a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:34.744733 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e8621641-eda6-45cd-9a54-3367bdc23e9a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:34.745171 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e8621641-eda6-45cd-9a54-3367bdc23e9a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:34.886896 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-e8621641-eda6-45cd-9a54-3367bdc23e9a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:34.894750 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e8621641-eda6-45cd-9a54-3367bdc23e9a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.162834 Jun 23 20:16:34.895304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 468/960] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:34 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:35.912005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1672d7fe-f2ec-47e3-a235-6ba7ce895780 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:35.912636 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1672d7fe-f2ec-47e3-a235-6ba7ce895780 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:35.919101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1672d7fe-f2ec-47e3-a235-6ba7ce895780 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:35.919535 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1672d7fe-f2ec-47e3-a235-6ba7ce895780 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:35.920274 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1672d7fe-f2ec-47e3-a235-6ba7ce895780 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:35.920722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1672d7fe-f2ec-47e3-a235-6ba7ce895780 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:36.059362 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1672d7fe-f2ec-47e3-a235-6ba7ce895780 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:36.067272 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1672d7fe-f2ec-47e3-a235-6ba7ce895780 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.159113 Jun 23 20:16:36.067834 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 493/961] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:35 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:37.084851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4ba781da-741b-4a33-a08b-52c70eaf9e1d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:37.086084 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4ba781da-741b-4a33-a08b-52c70eaf9e1d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:37.092014 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ba781da-741b-4a33-a08b-52c70eaf9e1d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:37.092495 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ba781da-741b-4a33-a08b-52c70eaf9e1d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:37.093240 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ba781da-741b-4a33-a08b-52c70eaf9e1d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:37.093678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4ba781da-741b-4a33-a08b-52c70eaf9e1d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:37.111432 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=100 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:37.240600 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4ba781da-741b-4a33-a08b-52c70eaf9e1d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:37.248756 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4ba781da-741b-4a33-a08b-52c70eaf9e1d tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.168274 Jun 23 20:16:37.249312 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 469/962] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:37 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:38.266293 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-67a2d943-0749-45f0-9fcf-5564e2f9e176 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:38.266864 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-67a2d943-0749-45f0-9fcf-5564e2f9e176 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:38.273331 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-67a2d943-0749-45f0-9fcf-5564e2f9e176 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:38.273778 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-67a2d943-0749-45f0-9fcf-5564e2f9e176 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:38.274536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-67a2d943-0749-45f0-9fcf-5564e2f9e176 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:38.274986 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-67a2d943-0749-45f0-9fcf-5564e2f9e176 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:38.417399 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-67a2d943-0749-45f0-9fcf-5564e2f9e176 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:38.425312 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-67a2d943-0749-45f0-9fcf-5564e2f9e176 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.162930 Jun 23 20:16:38.425927 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 494/963] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:38 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:39.263493 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-99649b0b-5d7c-496f-8654-0d23742f7fba tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b01a5cc5-7b99-4cee-b69c-b0a5b8112a98", "device": "/dev/sdb"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:39.265143 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-99649b0b-5d7c-496f-8654-0d23742f7fba tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:39.271558 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99649b0b-5d7c-496f-8654-0d23742f7fba tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:39.272010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99649b0b-5d7c-496f-8654-0d23742f7fba tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:39.272806 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99649b0b-5d7c-496f-8654-0d23742f7fba tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:39.273243 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-99649b0b-5d7c-496f-8654-0d23742f7fba tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:39.442940 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1bb48870-1624-404b-9523-923e89dc2ed3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:39.443534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1bb48870-1624-404b-9523-923e89dc2ed3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:39.450053 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1bb48870-1624-404b-9523-923e89dc2ed3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:39.450573 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1bb48870-1624-404b-9523-923e89dc2ed3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:39.451304 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1bb48870-1624-404b-9523-923e89dc2ed3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:39.451733 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1bb48870-1624-404b-9523-923e89dc2ed3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:39.604369 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1bb48870-1624-404b-9523-923e89dc2ed3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:39.612775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1bb48870-1624-404b-9523-923e89dc2ed3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.173713 Jun 23 20:16:39.613372 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 495/964] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:39 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:39.994173 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-99649b0b-5d7c-496f-8654-0d23742f7fba tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "POST /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.734387 Jun 23 20:16:39.994797 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 470/965] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:16:39 2022] POST /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998/os-volume_attachments => generated 194 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:40.630339 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-26024d50-5227-4586-a1d8-dd6adb223640 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:40.630969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-26024d50-5227-4586-a1d8-dd6adb223640 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:40.638023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-26024d50-5227-4586-a1d8-dd6adb223640 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:40.638467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-26024d50-5227-4586-a1d8-dd6adb223640 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:40.639217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-26024d50-5227-4586-a1d8-dd6adb223640 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:40.639649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-26024d50-5227-4586-a1d8-dd6adb223640 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:40.780731 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-26024d50-5227-4586-a1d8-dd6adb223640 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:40.789210 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-26024d50-5227-4586-a1d8-dd6adb223640 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.162738 Jun 23 20:16:40.789768 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 496/966] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:40 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:41.807661 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-19a20aaa-1d76-4bca-ac42-d171e14196dd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:41.808274 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-19a20aaa-1d76-4bca-ac42-d171e14196dd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:41.814685 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19a20aaa-1d76-4bca-ac42-d171e14196dd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:41.815133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19a20aaa-1d76-4bca-ac42-d171e14196dd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:41.815886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19a20aaa-1d76-4bca-ac42-d171e14196dd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:41.816343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19a20aaa-1d76-4bca-ac42-d171e14196dd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:41.958133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-19a20aaa-1d76-4bca-ac42-d171e14196dd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:41.966277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-19a20aaa-1d76-4bca-ac42-d171e14196dd tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.163859 Jun 23 20:16:41.966852 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 471/967] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:41 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:16:42.982951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2c8f2557-67c2-4d5b-8ff0-8507b20ad237 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:42.983552 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2c8f2557-67c2-4d5b-8ff0-8507b20ad237 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:42.990246 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2c8f2557-67c2-4d5b-8ff0-8507b20ad237 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:42.990686 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2c8f2557-67c2-4d5b-8ff0-8507b20ad237 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:42.992087 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2c8f2557-67c2-4d5b-8ff0-8507b20ad237 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:42.992553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2c8f2557-67c2-4d5b-8ff0-8507b20ad237 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:43.136452 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2c8f2557-67c2-4d5b-8ff0-8507b20ad237 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:43.144399 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2c8f2557-67c2-4d5b-8ff0-8507b20ad237 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.165315 Jun 23 20:16:43.144960 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 497/968] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:42 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:44.161526 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6b273b10-932c-4366-98fb-c4f40c2d8f36 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:44.162111 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6b273b10-932c-4366-98fb-c4f40c2d8f36 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:44.168778 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b273b10-932c-4366-98fb-c4f40c2d8f36 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:44.169223 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b273b10-932c-4366-98fb-c4f40c2d8f36 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:44.169983 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b273b10-932c-4366-98fb-c4f40c2d8f36 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:44.170415 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6b273b10-932c-4366-98fb-c4f40c2d8f36 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:44.332717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6b273b10-932c-4366-98fb-c4f40c2d8f36 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:44.340894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6b273b10-932c-4366-98fb-c4f40c2d8f36 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1755 microversion: 2.1 time: 0.183314 Jun 23 20:16:44.341466 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 472/969] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:44 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:45.357725 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-84e7cdb9-7957-42ac-bd2f-3d1c54044ff2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:45.358334 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-84e7cdb9-7957-42ac-bd2f-3d1c54044ff2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:45.364735 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-84e7cdb9-7957-42ac-bd2f-3d1c54044ff2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:45.365183 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-84e7cdb9-7957-42ac-bd2f-3d1c54044ff2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:45.365933 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-84e7cdb9-7957-42ac-bd2f-3d1c54044ff2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:45.366363 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-84e7cdb9-7957-42ac-bd2f-3d1c54044ff2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:45.509078 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-84e7cdb9-7957-42ac-bd2f-3d1c54044ff2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:16:45.516988 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-84e7cdb9-7957-42ac-bd2f-3d1c54044ff2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1758 microversion: 2.1 time: 0.163037 Jun 23 20:16:45.517578 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 498/970] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:16:45 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:16:53.561137 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-791ab2c1-2787-4380-9fbd-69d32c09d22f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:16:53.561708 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-791ab2c1-2787-4380-9fbd-69d32c09d22f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:53.568209 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-791ab2c1-2787-4380-9fbd-69d32c09d22f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:53.568681 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-791ab2c1-2787-4380-9fbd-69d32c09d22f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:53.569524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-791ab2c1-2787-4380-9fbd-69d32c09d22f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:53.569953 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-791ab2c1-2787-4380-9fbd-69d32c09d22f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:53.593713 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-791ab2c1-2787-4380-9fbd-69d32c09d22f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/ips" status: 200 len: 145 microversion: 2.1 time: 0.036561 Jun 23 20:16:53.594268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 473/971] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:16:53 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:16:56.166838 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-892ebd64-f73e-4172-8b4c-298fc5802775 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78e453b9-f662-4ab8-a9f3-0a2ca8665c52"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:16:56.167946 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-892ebd64-f73e-4172-8b4c-298fc5802775 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:16:56.170258 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=16 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:56.171056 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:16:56.175561 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-892ebd64-f73e-4172-8b4c-298fc5802775 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:56.178613 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-892ebd64-f73e-4172-8b4c-298fc5802775 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:56.178613 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-892ebd64-f73e-4172-8b4c-298fc5802775 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:16:56.178613 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-892ebd64-f73e-4172-8b4c-298fc5802775 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:16:57.011577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-892ebd64-f73e-4172-8b4c-298fc5802775 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848533 Jun 23 20:16:57.012187 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 499/972] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:16:56 2022] POST /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:04.566009 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-000a1594-eba9-4d11-be6c-9892d3ae902d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:04.566516 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-000a1594-eba9-4d11-be6c-9892d3ae902d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:04.569061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=13 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:04.569719 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:04.574900 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-000a1594-eba9-4d11-be6c-9892d3ae902d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:04.575348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-000a1594-eba9-4d11-be6c-9892d3ae902d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:04.576102 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-000a1594-eba9-4d11-be6c-9892d3ae902d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:04.576580 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-000a1594-eba9-4d11-be6c-9892d3ae902d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:04.656440 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-000a1594-eba9-4d11-be6c-9892d3ae902d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lazy-loading 'services' on Instance uuid de3437f7-7812-42da-97dc-6bb6b35fc998 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:17:04.875330 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-000a1594-eba9-4d11-be6c-9892d3ae902d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "DELETE /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998/os-volume_attachments/b01a5cc5-7b99-4cee-b69c-b0a5b8112a98" status: 202 len: 0 microversion: 2.1 time: 0.313031 Jun 23 20:17:04.875948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 474/973] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:17:04 2022] DELETE /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998/os-volume_attachments/b01a5cc5-7b99-4cee-b69c-b0a5b8112a98 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:17:07.660930 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:07.661696 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:07.665774 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-75b3ee72-3a08-4d92-994c-1156d089ad20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:07.666770 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-75b3ee72-3a08-4d92-994c-1156d089ad20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:07.672749 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75b3ee72-3a08-4d92-994c-1156d089ad20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:07.673195 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75b3ee72-3a08-4d92-994c-1156d089ad20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:07.673958 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75b3ee72-3a08-4d92-994c-1156d089ad20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:07.674394 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75b3ee72-3a08-4d92-994c-1156d089ad20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:07.705533 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-75b3ee72-3a08-4d92-994c-1156d089ad20 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Jun 23 20:17:07.706083 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 500/974] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:17:07 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:07.717379 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-19393fdd-5e0a-4acc-9975-b928a999c70f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:07.718051 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-19393fdd-5e0a-4acc-9975-b928a999c70f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:07.724260 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19393fdd-5e0a-4acc-9975-b928a999c70f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:07.724748 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19393fdd-5e0a-4acc-9975-b928a999c70f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:07.725508 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19393fdd-5e0a-4acc-9975-b928a999c70f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:07.725948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-19393fdd-5e0a-4acc-9975-b928a999c70f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:07.755199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-19393fdd-5e0a-4acc-9975-b928a999c70f tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/78e453b9-f662-4ab8-a9f3-0a2ca8665c52" status: 200 len: 194 microversion: 2.1 time: 0.042659 Jun 23 20:17:07.755784 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 475/975] 10.222.0.44 () {58 vars in 1412 bytes} [Thu Jun 23 20:17:07 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/78e453b9-f662-4ab8-a9f3-0a2ca8665c52 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:08.102726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-d14675b4-9a3a-49b3-9574-763a5384eda5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:08.103209 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d14675b4-9a3a-49b3-9574-763a5384eda5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:08.112610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d14675b4-9a3a-49b3-9574-763a5384eda5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:08.113053 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d14675b4-9a3a-49b3-9574-763a5384eda5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:08.113890 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d14675b4-9a3a-49b3-9574-763a5384eda5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:08.114317 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-d14675b4-9a3a-49b3-9574-763a5384eda5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:08.142094 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-d14675b4-9a3a-49b3-9574-763a5384eda5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:17:08.424727 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-d14675b4-9a3a-49b3-9574-763a5384eda5 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "DELETE /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 204 len: 0 microversion: 2.1 time: 0.325734 Jun 23 20:17:08.425339 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 501/976] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:17:08 2022] DELETE /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:17:08.436371 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a46072d6-cd0f-4953-9f82-4e64b8cfb6f6 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:08.438889 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a46072d6-cd0f-4953-9f82-4e64b8cfb6f6 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:08.443374 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a46072d6-cd0f-4953-9f82-4e64b8cfb6f6 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:08.443931 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a46072d6-cd0f-4953-9f82-4e64b8cfb6f6 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:08.444775 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a46072d6-cd0f-4953-9f82-4e64b8cfb6f6 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:08.445321 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a46072d6-cd0f-4953-9f82-4e64b8cfb6f6 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:08.592747 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a46072d6-cd0f-4953-9f82-4e64b8cfb6f6 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:08.600584 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a46072d6-cd0f-4953-9f82-4e64b8cfb6f6 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1511 microversion: 2.1 time: 0.169355 Jun 23 20:17:08.601152 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 476/977] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:08 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:09.414213 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fd28c401-3fc3-4caf-9797-9e589772ebfe tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19fd52d5-a1e0-40f5-81f0-406b31957f87"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:09.415357 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fd28c401-3fc3-4caf-9797-9e589772ebfe tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:09.422796 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fd28c401-3fc3-4caf-9797-9e589772ebfe tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:09.423243 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fd28c401-3fc3-4caf-9797-9e589772ebfe tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:09.423996 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fd28c401-3fc3-4caf-9797-9e589772ebfe tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:09.424470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fd28c401-3fc3-4caf-9797-9e589772ebfe tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:09.618360 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-507a9a60-c04e-4835-bff9-93303173330d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:09.618959 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-507a9a60-c04e-4835-bff9-93303173330d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:09.625970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-507a9a60-c04e-4835-bff9-93303173330d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:09.626410 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-507a9a60-c04e-4835-bff9-93303173330d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:09.627158 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-507a9a60-c04e-4835-bff9-93303173330d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:09.627588 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-507a9a60-c04e-4835-bff9-93303173330d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:09.754687 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-507a9a60-c04e-4835-bff9-93303173330d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:09.762151 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-507a9a60-c04e-4835-bff9-93303173330d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1511 microversion: 2.1 time: 0.147712 Jun 23 20:17:09.762710 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 477/978] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:09 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:17:10.548730 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fd28c401-3fc3-4caf-9797-9e589772ebfe tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "POST /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.138493 Jun 23 20:17:10.549415 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 502/979] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:17:09 2022] POST /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:10.780241 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-be02c381-36e4-4612-81c8-b9b9ed854bdd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:10.780880 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-be02c381-36e4-4612-81c8-b9b9ed854bdd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:10.788886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be02c381-36e4-4612-81c8-b9b9ed854bdd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:10.789337 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be02c381-36e4-4612-81c8-b9b9ed854bdd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:10.790116 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be02c381-36e4-4612-81c8-b9b9ed854bdd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:10.790728 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-be02c381-36e4-4612-81c8-b9b9ed854bdd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:10.824890 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-41681244-be5b-48f5-b244-7c11509757db req-7f0a14df-d638-497e-ba69-70bab0b3b700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3437f7-7812-42da-97dc-6bb6b35fc998", "name": "network-vif-deleted", "tag": "e2f74ae4-0534-4d6c-9e6d-45568ca17ad6"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:10.833537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-41681244-be5b-48f5-b244-7c11509757db req-7f0a14df-d638-497e-ba69-70bab0b3b700 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:10.835179 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-41681244-be5b-48f5-b244-7c11509757db req-7f0a14df-d638-497e-ba69-70bab0b3b700 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:10.845196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-41681244-be5b-48f5-b244-7c11509757db req-7f0a14df-d638-497e-ba69-70bab0b3b700 service nova] Creating event network-vif-deleted:e2f74ae4-0534-4d6c-9e6d-45568ca17ad6 for instance de3437f7-7812-42da-97dc-6bb6b35fc998 on hv-cinder-84727 Jun 23 20:17:10.849974 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-41681244-be5b-48f5-b244-7c11509757db req-7f0a14df-d638-497e-ba69-70bab0b3b700 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031816 Jun 23 20:17:10.850678 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 503/980] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:17:10.871576 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-be02c381-36e4-4612-81c8-b9b9ed854bdd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:10.879595 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-be02c381-36e4-4612-81c8-b9b9ed854bdd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 200 len: 1469 microversion: 2.1 time: 0.104594 Jun 23 20:17:10.880162 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 478/981] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:10 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 1469 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:11.897852 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:11.898578 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: de3437f7-7812-42da-97dc-6bb6b35fc998] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:11.904767 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:11.905215 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:11.905969 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:11.906434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:11.919755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] HTTP exception thrown: Instance de3437f7-7812-42da-97dc-6bb6b35fc998 could not be found. Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Request method failure captured: Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 HTTP/1.1 Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMoG3USuQrHLT5jpl5BFkIUNVNVKUTDmBzMF6NPdc_nWkq4U7ECNWTCM2auL7o7x0JSMko3h4iXOpn0T9Oswqk7ZpQqUlaxeci7FFnxmI2_7j8VrWn0gs2HGcKVJsCEgjb9r9WUi61k0471HhdoMBD3b17qlG-prFuo-JEZXWb_T9UI Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: eccb032b11e045fdbb42238762eada05 Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1435306937 Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:17:11.921367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_eccb032b11e045fdbb42238762eada05", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eccb032b11e045fdbb42238762eada05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eccb032b11e045fdbb42238762eada05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/eccb032b11e045fdbb42238762eada05"}]}] Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-VolumesSnapshotTestJSON-1435306937 Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: eccb032b11e045fdbb42238762eada05 Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1435306937 Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-VolumesSnapshotTestJSON-1435306937-project Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 1b02048ea85d46889e86bb8d073bf456 Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-VolumesSnapshotTestJSON-1435306937-project Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance de3437f7-7812-42da-97dc-6bb6b35fc998 could not be found. Jun 23 20:17:11.923116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'de3437f7-7812-42da-97dc-6bb6b35fc998'} Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de3437f7-7812-42da-97dc-6bb6b35fc998 could not be found. Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:11.924128 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de3437f7-7812-42da-97dc-6bb6b35fc998 could not be found. Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de3437f7-7812-42da-97dc-6bb6b35fc998 could not be found. Jun 23 20:17:11.925789 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:11.927483 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Returning 404 to user: Instance de3437f7-7812-42da-97dc-6bb6b35fc998 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:11.927483 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8f711e98-9526-45c7-987e-e8a405093f4d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998" status: 404 len: 111 microversion: 2.1 time: 0.029553 Jun 23 20:17:11.927483 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 504/982] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:11 2022] GET /compute/v2.1/servers/de3437f7-7812-42da-97dc-6bb6b35fc998 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:19.140050 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6492d2ea-a426-4d8d-97b5-29cf08695627 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:19.141099 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6492d2ea-a426-4d8d-97b5-29cf08695627 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:19.147670 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6492d2ea-a426-4d8d-97b5-29cf08695627 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:19.148124 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6492d2ea-a426-4d8d-97b5-29cf08695627 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:19.148915 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6492d2ea-a426-4d8d-97b5-29cf08695627 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:19.149349 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6492d2ea-a426-4d8d-97b5-29cf08695627 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:19.178096 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6492d2ea-a426-4d8d-97b5-29cf08695627 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042508 Jun 23 20:17:19.178633 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 479/983] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:17:19 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:19.282942 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fc59c85f-a1a4-43dd-bea9-67a24d0de506 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:19.283541 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fc59c85f-a1a4-43dd-bea9-67a24d0de506 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:19.290037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc59c85f-a1a4-43dd-bea9-67a24d0de506 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:19.290484 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc59c85f-a1a4-43dd-bea9-67a24d0de506 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:19.291235 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc59c85f-a1a4-43dd-bea9-67a24d0de506 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:19.291667 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc59c85f-a1a4-43dd-bea9-67a24d0de506 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:19.320065 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fc59c85f-a1a4-43dd-bea9-67a24d0de506 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/78e453b9-f662-4ab8-a9f3-0a2ca8665c52" status: 200 len: 194 microversion: 2.1 time: 0.041075 Jun 23 20:17:19.320661 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 505/984] 10.222.0.44 () {58 vars in 1412 bytes} [Thu Jun 23 20:17:19 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/78e453b9-f662-4ab8-a9f3-0a2ca8665c52 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:19.330511 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-82d2eafe-6d57-4f3c-b4a1-6af906919f38 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:19.331008 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-82d2eafe-6d57-4f3c-b4a1-6af906919f38 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:19.337263 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82d2eafe-6d57-4f3c-b4a1-6af906919f38 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:19.337716 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82d2eafe-6d57-4f3c-b4a1-6af906919f38 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:19.338470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82d2eafe-6d57-4f3c-b4a1-6af906919f38 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:19.338906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-82d2eafe-6d57-4f3c-b4a1-6af906919f38 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:19.417800 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-82d2eafe-6d57-4f3c-b4a1-6af906919f38 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'services' on Instance uuid fbf4d745-73cd-458d-9aa6-cef42480b9f2 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:17:19.595478 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-82d2eafe-6d57-4f3c-b4a1-6af906919f38 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/78e453b9-f662-4ab8-a9f3-0a2ca8665c52" status: 202 len: 0 microversion: 2.1 time: 0.268595 Jun 23 20:17:19.596071 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 480/985] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:17:19 2022] DELETE /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/78e453b9-f662-4ab8-a9f3-0a2ca8665c52 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:17:21.212637 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-284563814", "imageRef": "fa2480a3-c80f-4720-b9e7-fe2d1ddba95b", "flavorRef": "452", "networks": [{"uuid": "93615a59-0936-480e-a559-d91a2775b59b"}]}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:21.418788 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.network.neutron [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] validate_networks() for [('93615a59-0936-480e-a559-d91a2775b59b', None, None, None, None, None)] {{(pid=118346) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:17:21.780949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Flavor limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:17:21.781368 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Image limits 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:17:21.781837 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Flavor pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:17:21.782240 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Image pref 0:0:0 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:17:21.782672 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.virt.hardware [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118346) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:17:21.791434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:21.791879 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:21.792708 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:21.793140 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:21.809949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Getting quotas for project eccb032b11e045fdbb42238762eada05. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:17:21.815148 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Getting quotas for user 1b02048ea85d46889e86bb8d073bf456 and project eccb032b11e045fdbb42238762eada05. Resources: {'instances', 'cores', 'ram'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:17:21.824637 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Going to run 1 instances... {{(pid=118346) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:17:21.826834 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa2480a3-c80f-4720-b9e7-fe2d1ddba95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118346) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:17:21.951990 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a10dbf85-63d0-4595-af79-594b6cca258f tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743467 Jun 23 20:17:21.952658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 506/986] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:17:21.968746 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-cb679597-3590-492c-8aaa-58e8cf12c732 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:21.970075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-cb679597-3590-492c-8aaa-58e8cf12c732 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:22.133428 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-cb679597-3590-492c-8aaa-58e8cf12c732 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:22.140048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-cb679597-3590-492c-8aaa-58e8cf12c732 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1218 microversion: 2.1 time: 0.176099 Jun 23 20:17:22.141674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 481/987] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:21 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:22.809369 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3ee8a09f-55d1-493d-88ef-6676407467a8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:22.809889 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3ee8a09f-55d1-493d-88ef-6676407467a8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:22.816337 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3ee8a09f-55d1-493d-88ef-6676407467a8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:22.816734 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3ee8a09f-55d1-493d-88ef-6676407467a8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:22.817481 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3ee8a09f-55d1-493d-88ef-6676407467a8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:22.818679 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3ee8a09f-55d1-493d-88ef-6676407467a8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:22.849749 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3ee8a09f-55d1-493d-88ef-6676407467a8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/19fd52d5-a1e0-40f5-81f0-406b31957f87" status: 200 len: 194 microversion: 2.1 time: 0.044797 Jun 23 20:17:22.850336 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 507/988] 10.222.0.44 () {58 vars in 1412 bytes} [Thu Jun 23 20:17:22 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/19fd52d5-a1e0-40f5-81f0-406b31957f87 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:22.861038 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a1808882-c6c2-4100-8fdd-122a09e2908d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:22.861661 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a1808882-c6c2-4100-8fdd-122a09e2908d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:22.868625 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a1808882-c6c2-4100-8fdd-122a09e2908d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:22.869075 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a1808882-c6c2-4100-8fdd-122a09e2908d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:22.869843 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a1808882-c6c2-4100-8fdd-122a09e2908d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:22.870282 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a1808882-c6c2-4100-8fdd-122a09e2908d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:22.951386 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-a1808882-c6c2-4100-8fdd-122a09e2908d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lazy-loading 'services' on Instance uuid fbf4d745-73cd-458d-9aa6-cef42480b9f2 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:17:23.144678 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a1808882-c6c2-4100-8fdd-122a09e2908d tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/19fd52d5-a1e0-40f5-81f0-406b31957f87" status: 202 len: 0 microversion: 2.1 time: 0.287181 Jun 23 20:17:23.145375 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 482/989] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:17:22 2022] DELETE /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments/19fd52d5-a1e0-40f5-81f0-406b31957f87 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:17:23.158117 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-dd51a82f-42f0-41d2-99d5-afe87c95b9a3 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:23.159063 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-dd51a82f-42f0-41d2-99d5-afe87c95b9a3 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:23.166287 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd51a82f-42f0-41d2-99d5-afe87c95b9a3 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:23.168867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd51a82f-42f0-41d2-99d5-afe87c95b9a3 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:23.168867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd51a82f-42f0-41d2-99d5-afe87c95b9a3 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:23.168867 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-dd51a82f-42f0-41d2-99d5-afe87c95b9a3 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:23.263507 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-dd51a82f-42f0-41d2-99d5-afe87c95b9a3 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:23.271535 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-dd51a82f-42f0-41d2-99d5-afe87c95b9a3 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1270 microversion: 2.1 time: 0.118414 Jun 23 20:17:23.272101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 508/990] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:23 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:24.220496 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ca16c37d-daf7-488a-ab36-9c36af3ddd7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1816725656"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:24.221701 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ca16c37d-daf7-488a-ab36-9c36af3ddd7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:24.239048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ca16c37d-daf7-488a-ab36-9c36af3ddd7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:24.245149 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ca16c37d-daf7-488a-ab36-9c36af3ddd7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:24.246534 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ca16c37d-daf7-488a-ab36-9c36af3ddd7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:24.246980 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ca16c37d-daf7-488a-ab36-9c36af3ddd7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:24.289373 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-921bfb6c-4699-4d9e-b54b-d1c1eb93924e tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:24.290846 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-921bfb6c-4699-4d9e-b54b-d1c1eb93924e tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:24.297203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-921bfb6c-4699-4d9e-b54b-d1c1eb93924e tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:24.297858 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-921bfb6c-4699-4d9e-b54b-d1c1eb93924e tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:24.298617 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-921bfb6c-4699-4d9e-b54b-d1c1eb93924e tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:24.299213 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-921bfb6c-4699-4d9e-b54b-d1c1eb93924e tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:24.476279 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.network.security_group_api [None req-ca16c37d-daf7-488a-ab36-9c36af3ddd7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Removing security group 9b454e09-45ae-4c25-aa5c-aa65450f4a48 from port 077883ce-f410-4855-8c89-e480ffa737bf Jun 23 20:17:24.576915 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-921bfb6c-4699-4d9e-b54b-d1c1eb93924e tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:24.584438 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-921bfb6c-4699-4d9e-b54b-d1c1eb93924e tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1288 microversion: 2.1 time: 0.298767 Jun 23 20:17:24.585003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 509/991] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:24 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1288 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:17:25.138575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ca16c37d-daf7-488a-ab36-9c36af3ddd7f tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "POST /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/action" status: 202 len: 0 microversion: 2.1 time: 0.924802 Jun 23 20:17:25.139489 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 483/992] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:17:24 2022] POST /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/action => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:17:25.151076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-796a4a80-ac3d-46bd-9e07-c86f02acb0a2 req-6fca03aa-1af0-4ec4-bbdb-c67ef7456e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c6eafe-f596-4262-9487-4cd023a99823", "tag": "077883ce-f410-4855-8c89-e480ffa737bf"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:25.171886 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-796a4a80-ac3d-46bd-9e07-c86f02acb0a2 req-6fca03aa-1af0-4ec4-bbdb-c67ef7456e10 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:25.172710 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-796a4a80-ac3d-46bd-9e07-c86f02acb0a2 req-6fca03aa-1af0-4ec4-bbdb-c67ef7456e10 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:25.209658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-796a4a80-ac3d-46bd-9e07-c86f02acb0a2 req-6fca03aa-1af0-4ec4-bbdb-c67ef7456e10 service nova] Creating event network-changed:077883ce-f410-4855-8c89-e480ffa737bf for instance e9c6eafe-f596-4262-9487-4cd023a99823 on hv-cinder-84727 Jun 23 20:17:25.218546 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-796a4a80-ac3d-46bd-9e07-c86f02acb0a2 req-6fca03aa-1af0-4ec4-bbdb-c67ef7456e10 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071704 Jun 23 20:17:25.219467 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 510/993] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:25.443043 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-81ebcd8b-d5e9-437b-97d1-d307c4147728 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:25.444793 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-81ebcd8b-d5e9-437b-97d1-d307c4147728 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:25.454224 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81ebcd8b-d5e9-437b-97d1-d307c4147728 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:25.454937 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81ebcd8b-d5e9-437b-97d1-d307c4147728 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:25.455894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81ebcd8b-d5e9-437b-97d1-d307c4147728 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:25.456516 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-81ebcd8b-d5e9-437b-97d1-d307c4147728 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:25.501089 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-81ebcd8b-d5e9-437b-97d1-d307c4147728 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065243 Jun 23 20:17:25.502469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 484/994] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:17:25 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 20:17:25.603729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-db497b28-759d-4e67-a793-c8eb2585e0cd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:25.605052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-db497b28-759d-4e67-a793-c8eb2585e0cd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:25.614524 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db497b28-759d-4e67-a793-c8eb2585e0cd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:25.614949 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db497b28-759d-4e67-a793-c8eb2585e0cd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:25.615722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db497b28-759d-4e67-a793-c8eb2585e0cd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:25.616183 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-db497b28-759d-4e67-a793-c8eb2585e0cd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:25.658461 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-39411d6d-6b01-41de-b2ef-611efbf60120 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:25.659450 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-39411d6d-6b01-41de-b2ef-611efbf60120 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:25.669022 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39411d6d-6b01-41de-b2ef-611efbf60120 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:25.669479 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39411d6d-6b01-41de-b2ef-611efbf60120 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:25.670259 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39411d6d-6b01-41de-b2ef-611efbf60120 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:25.670696 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-39411d6d-6b01-41de-b2ef-611efbf60120 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:25.702159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-39411d6d-6b01-41de-b2ef-611efbf60120 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047771 Jun 23 20:17:25.702732 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 485/995] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:17:25 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 20:17:25.764572 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a6fa1eae-9dad-4235-a85f-e2de57b73e2c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:25.765361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a6fa1eae-9dad-4235-a85f-e2de57b73e2c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:25.771528 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a6fa1eae-9dad-4235-a85f-e2de57b73e2c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:25.772172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a6fa1eae-9dad-4235-a85f-e2de57b73e2c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:25.773160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a6fa1eae-9dad-4235-a85f-e2de57b73e2c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:25.773745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a6fa1eae-9dad-4235-a85f-e2de57b73e2c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:25.800681 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a6fa1eae-9dad-4235-a85f-e2de57b73e2c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:17:25.979367 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-db497b28-759d-4e67-a793-c8eb2585e0cd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:25.987019 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-db497b28-759d-4e67-a793-c8eb2585e0cd tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1318 microversion: 2.1 time: 0.387914 Jun 23 20:17:25.992702 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 511/996] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:25 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:26.087244 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a6fa1eae-9dad-4235-a85f-e2de57b73e2c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 204 len: 0 microversion: 2.1 time: 0.326819 Jun 23 20:17:26.088024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 486/997] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:17:25 2022] DELETE /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 20:17:26.097002 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6fc8a36f-7ac3-4e1d-8f68-799b5ac6d97c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:26.097823 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6fc8a36f-7ac3-4e1d-8f68-799b5ac6d97c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:26.103739 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6fc8a36f-7ac3-4e1d-8f68-799b5ac6d97c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:26.104183 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6fc8a36f-7ac3-4e1d-8f68-799b5ac6d97c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:26.105508 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6fc8a36f-7ac3-4e1d-8f68-799b5ac6d97c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:26.105937 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6fc8a36f-7ac3-4e1d-8f68-799b5ac6d97c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:26.388755 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-6fc8a36f-7ac3-4e1d-8f68-799b5ac6d97c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:26.396227 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6fc8a36f-7ac3-4e1d-8f68-799b5ac6d97c tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1673 microversion: 2.1 time: 0.303162 Jun 23 20:17:26.396811 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 512/998] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:26 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1673 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:27.004652 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b8143fda-5cf5-4251-97b4-5f4741091297 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:27.005354 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b8143fda-5cf5-4251-97b4-5f4741091297 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:27.011875 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b8143fda-5cf5-4251-97b4-5f4741091297 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:27.012338 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b8143fda-5cf5-4251-97b4-5f4741091297 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:27.013098 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b8143fda-5cf5-4251-97b4-5f4741091297 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:27.013530 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b8143fda-5cf5-4251-97b4-5f4741091297 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:27.218802 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b8143fda-5cf5-4251-97b4-5f4741091297 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:27.226291 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b8143fda-5cf5-4251-97b4-5f4741091297 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1318 microversion: 2.1 time: 0.225915 Jun 23 20:17:27.227052 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 487/999] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:26 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:27.262274 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-f0c2612f-7ef7-40d9-b56c-2330a7899dda req-cefb5cf2-3c10-4373-aede-1208a544da23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff0a60e8-ccc9-4147-99a3-2e0e3255f91e", "tag": "b8106523-839e-4862-bb0b-0f13d8cbb6fd"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:27.270840 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-f0c2612f-7ef7-40d9-b56c-2330a7899dda req-cefb5cf2-3c10-4373-aede-1208a544da23 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:27.271296 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-f0c2612f-7ef7-40d9-b56c-2330a7899dda req-cefb5cf2-3c10-4373-aede-1208a544da23 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:27.282417 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-f0c2612f-7ef7-40d9-b56c-2330a7899dda req-cefb5cf2-3c10-4373-aede-1208a544da23 service nova] Creating event network-changed:b8106523-839e-4862-bb0b-0f13d8cbb6fd for instance ff0a60e8-ccc9-4147-99a3-2e0e3255f91e on hv-cinder-84727 Jun 23 20:17:27.287000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-f0c2612f-7ef7-40d9-b56c-2330a7899dda req-cefb5cf2-3c10-4373-aede-1208a544da23 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028442 Jun 23 20:17:27.287583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 513/1000] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:27.362239 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-58be62d5-ddd0-4254-bcc6-540368b94157 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:27.362733 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-58be62d5-ddd0-4254-bcc6-540368b94157 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:27.368818 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58be62d5-ddd0-4254-bcc6-540368b94157 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:27.369266 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58be62d5-ddd0-4254-bcc6-540368b94157 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:27.370020 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58be62d5-ddd0-4254-bcc6-540368b94157 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:27.370964 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-58be62d5-ddd0-4254-bcc6-540368b94157 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:27.375583 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:27.415336 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-bed4fe57-126c-4427-8e19-612e73a0612a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:27.419632 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-bed4fe57-126c-4427-8e19-612e73a0612a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:27.423082 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bed4fe57-126c-4427-8e19-612e73a0612a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:27.423320 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bed4fe57-126c-4427-8e19-612e73a0612a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:27.424073 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bed4fe57-126c-4427-8e19-612e73a0612a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:27.424529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-bed4fe57-126c-4427-8e19-612e73a0612a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:27.458384 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-58be62d5-ddd0-4254-bcc6-540368b94157 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lazy-loading 'services' on Instance uuid e9c6eafe-f596-4262-9487-4cd023a99823 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:17:27.581804 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-bed4fe57-126c-4427-8e19-612e73a0612a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:27.591268 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-bed4fe57-126c-4427-8e19-612e73a0612a tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1673 microversion: 2.1 time: 0.181640 Jun 23 20:17:27.592279 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 514/1001] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:27 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:17:27.646612 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-58be62d5-ddd0-4254-bcc6-540368b94157 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments/91d5c42e-846f-4249-b04f-24476e1865a7" status: 202 len: 0 microversion: 2.1 time: 0.288101 Jun 23 20:17:27.647695 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 488/1002] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:17:27 2022] DELETE /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments/91d5c42e-846f-4249-b04f-24476e1865a7 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:17:27.657068 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-47611cc4-6d40-42d0-882a-43d3694d97b0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:27.660701 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-47611cc4-6d40-42d0-882a-43d3694d97b0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:27.664011 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-47611cc4-6d40-42d0-882a-43d3694d97b0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:27.664680 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-47611cc4-6d40-42d0-882a-43d3694d97b0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:27.665551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-47611cc4-6d40-42d0-882a-43d3694d97b0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:27.666190 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-47611cc4-6d40-42d0-882a-43d3694d97b0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:27.696823 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-47611cc4-6d40-42d0-882a-43d3694d97b0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Jun 23 20:17:27.697385 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 515/1003] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:17:27 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:28.245545 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7b8ed442-f59a-45d8-871f-cdcd093242a7 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:28.246760 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7b8ed442-f59a-45d8-871f-cdcd093242a7 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:28.253280 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b8ed442-f59a-45d8-871f-cdcd093242a7 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:28.253797 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b8ed442-f59a-45d8-871f-cdcd093242a7 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:28.254631 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b8ed442-f59a-45d8-871f-cdcd093242a7 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:28.255128 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7b8ed442-f59a-45d8-871f-cdcd093242a7 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:28.471514 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7b8ed442-f59a-45d8-871f-cdcd093242a7 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:28.479636 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7b8ed442-f59a-45d8-871f-cdcd093242a7 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1318 microversion: 2.1 time: 0.240000 Jun 23 20:17:28.489862 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 489/1004] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:28 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:28.608604 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a6a0dd47-ac54-4fb9-8e9a-e7c8113973a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:28.609217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-a6a0dd47-ac54-4fb9-8e9a-e7c8113973a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:28.616088 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a6a0dd47-ac54-4fb9-8e9a-e7c8113973a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:28.618330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a6a0dd47-ac54-4fb9-8e9a-e7c8113973a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:28.618330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a6a0dd47-ac54-4fb9-8e9a-e7c8113973a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:28.618330 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-a6a0dd47-ac54-4fb9-8e9a-e7c8113973a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:28.715677 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-e3eae8d5-5d96-4ae1-8e44-a176d2c619f6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:28.716961 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-e3eae8d5-5d96-4ae1-8e44-a176d2c619f6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:28.725348 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e3eae8d5-5d96-4ae1-8e44-a176d2c619f6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:28.728437 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e3eae8d5-5d96-4ae1-8e44-a176d2c619f6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:28.728437 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e3eae8d5-5d96-4ae1-8e44-a176d2c619f6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:28.728437 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-e3eae8d5-5d96-4ae1-8e44-a176d2c619f6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:28.762722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-e3eae8d5-5d96-4ae1-8e44-a176d2c619f6 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057379 Jun 23 20:17:28.769097 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 490/1005] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:17:28 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:17:28.846578 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-a6a0dd47-ac54-4fb9-8e9a-e7c8113973a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:28.851696 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:28.857766 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a6a0dd47-ac54-4fb9-8e9a-e7c8113973a0 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1673 microversion: 2.1 time: 0.252977 Jun 23 20:17:28.867401 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 516/1006] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:28 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1673 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:29.166457 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-8d41ccc5-6f8b-404b-955e-2504e46d9c41 req-a2e87b2b-6a53-4d40-94b6-258566c4710c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf4d745-73cd-458d-9aa6-cef42480b9f2", "name": "network-vif-deleted", "tag": "20228e09-3cd8-4ebb-a57a-0b23971f8745"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:29.174455 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8d41ccc5-6f8b-404b-955e-2504e46d9c41 req-a2e87b2b-6a53-4d40-94b6-258566c4710c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.178426 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8d41ccc5-6f8b-404b-955e-2504e46d9c41 req-a2e87b2b-6a53-4d40-94b6-258566c4710c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.185963 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-8d41ccc5-6f8b-404b-955e-2504e46d9c41 req-a2e87b2b-6a53-4d40-94b6-258566c4710c service nova] Creating event network-vif-deleted:20228e09-3cd8-4ebb-a57a-0b23971f8745 for instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 on hv-cinder-84727 Jun 23 20:17:29.190972 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-8d41ccc5-6f8b-404b-955e-2504e46d9c41 req-a2e87b2b-6a53-4d40-94b6-258566c4710c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028233 Jun 23 20:17:29.191554 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 491/1007] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:29.314593 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-7fb7b44e-2bbd-4c31-b946-3a76f34360f7 req-c2830010-507a-45ac-96a1-54a066ecf1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c6eafe-f596-4262-9487-4cd023a99823", "tag": "077883ce-f410-4855-8c89-e480ffa737bf"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:29.324710 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-7fb7b44e-2bbd-4c31-b946-3a76f34360f7 req-c2830010-507a-45ac-96a1-54a066ecf1c9 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.333018 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-7fb7b44e-2bbd-4c31-b946-3a76f34360f7 req-c2830010-507a-45ac-96a1-54a066ecf1c9 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.337586 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-7fb7b44e-2bbd-4c31-b946-3a76f34360f7 req-c2830010-507a-45ac-96a1-54a066ecf1c9 service nova] Creating event network-changed:077883ce-f410-4855-8c89-e480ffa737bf for instance e9c6eafe-f596-4262-9487-4cd023a99823 on hv-cinder-84727 Jun 23 20:17:29.342552 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-7fb7b44e-2bbd-4c31-b946-3a76f34360f7 req-c2830010-507a-45ac-96a1-54a066ecf1c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032887 Jun 23 20:17:29.343310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 517/1008] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:29.498694 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2a73308d-bd29-42f4-8e1f-8933d9bd7835 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:29.499498 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2a73308d-bd29-42f4-8e1f-8933d9bd7835 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:29.505782 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a73308d-bd29-42f4-8e1f-8933d9bd7835 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.512531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a73308d-bd29-42f4-8e1f-8933d9bd7835 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.512531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a73308d-bd29-42f4-8e1f-8933d9bd7835 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.512531 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2a73308d-bd29-42f4-8e1f-8933d9bd7835 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.653169 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2a73308d-bd29-42f4-8e1f-8933d9bd7835 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:29.660553 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2a73308d-bd29-42f4-8e1f-8933d9bd7835 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1318 microversion: 2.1 time: 0.167212 Jun 23 20:17:29.661233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 492/1009] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:29 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:29.777439 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-28ec3a12-0616-4ccb-893c-665a775707c1 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:29.777820 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-28ec3a12-0616-4ccb-893c-665a775707c1 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:29.785345 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28ec3a12-0616-4ccb-893c-665a775707c1 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.785872 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28ec3a12-0616-4ccb-893c-665a775707c1 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.786764 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28ec3a12-0616-4ccb-893c-665a775707c1 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.787267 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28ec3a12-0616-4ccb-893c-665a775707c1 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.820270 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-28ec3a12-0616-4ccb-893c-665a775707c1 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048957 Jun 23 20:17:29.821053 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 518/1010] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 23 20:17:29 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 20:17:29.831897 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:29.832475 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:29.839794 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.840252 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.841061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.841503 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.875536 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0db290e9-2c16-4697-b0de-36e37358e047 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:29.876394 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-0db290e9-2c16-4697-b0de-36e37358e047 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:29.882775 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0db290e9-2c16-4697-b0de-36e37358e047 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.883225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0db290e9-2c16-4697-b0de-36e37358e047 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.883983 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0db290e9-2c16-4697-b0de-36e37358e047 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:29.884487 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-0db290e9-2c16-4697-b0de-36e37358e047 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:29.926030 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] HTTP exception thrown: Instance e9c6eafe-f596-4262-9487-4cd023a99823 is not attached to volume 91d5c42e-846f-4249-b04f-24476e1865a7 Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Request method failure captured: Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments/91d5c42e-846f-4249-b04f-24476e1865a7 HTTP/1.1 Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMnKNK9fv-tq_vqj_WqpKDSA8B0GHcy_HFUMYNSAviGXJa3HZMHLXzwEy_jTxBRUh8KwxVD5HHxN50d7MMKXnf78xQOZSnJsBtCtyHDJ5mAqbmgBiYPiv_sNen3sqWa4DW7dFGxWTA7-O3gXpiWI9JWjWDVjWWHkNllfX7B-JLxFsdQ Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: a2028a4056254026b31f412942d1f576 Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-TestMinimumBasicScenario-1921927918 Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:29.928501 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a2028a4056254026b31f412942d1f576", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2028a4056254026b31f412942d1f576"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2028a4056254026b31f412942d1f576"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a2028a4056254026b31f412942d1f576"}]}] Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-TestMinimumBasicScenario-1921927918 Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: a2028a4056254026b31f412942d1f576 Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1921927918 Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-TestMinimumBasicScenario-1921927918-project Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: a9fe5380b3974516ac4e5b2fd9284348 Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-TestMinimumBasicScenario-1921927918-project Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:17:29.929969 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance e9c6eafe-f596-4262-9487-4cd023a99823 is not attached to volume 91d5c42e-846f-4249-b04f-24476e1865a7 Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'server_id': 'e9c6eafe-f596-4262-9487-4cd023a99823', 'id': '91d5c42e-846f-4249-b04f-24476e1865a7'} Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 91d5c42e-846f-4249-b04f-24476e1865a7. Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:29.930835 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c6eafe-f596-4262-9487-4cd023a99823 is not attached to volume 91d5c42e-846f-4249-b04f-24476e1865a7 Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c6eafe-f596-4262-9487-4cd023a99823 is not attached to volume 91d5c42e-846f-4249-b04f-24476e1865a7 Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:29.932159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Returning 404 to user: Instance e9c6eafe-f596-4262-9487-4cd023a99823 is not attached to volume 91d5c42e-846f-4249-b04f-24476e1865a7 {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:29.933765 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-8a913bc5-a75a-4c0a-b577-a6737a3556c3 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments/91d5c42e-846f-4249-b04f-24476e1865a7" status: 404 len: 154 microversion: 2.1 time: 0.102469 Jun 23 20:17:29.935234 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 493/1011] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:17:29 2022] DELETE /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823/os-volume_attachments/91d5c42e-846f-4249-b04f-24476e1865a7 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:29.971343 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-0db290e9-2c16-4697-b0de-36e37358e047 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c5e6ea89435497c8b1b06f42e08c82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed44d3eff7af4bd1bc339244e2bc2fae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:29.985230 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0db290e9-2c16-4697-b0de-36e37358e047 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 200 len: 1322 microversion: 2.1 time: 0.113470 Jun 23 20:17:29.985818 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 519/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:29 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 1322 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:17:30.677819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c9fd6a49-8a41-4414-abf6-79fc06caa773 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:30.678494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c9fd6a49-8a41-4414-abf6-79fc06caa773 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:30.685734 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c9fd6a49-8a41-4414-abf6-79fc06caa773 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:30.686280 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c9fd6a49-8a41-4414-abf6-79fc06caa773 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:30.687039 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c9fd6a49-8a41-4414-abf6-79fc06caa773 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:30.687469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c9fd6a49-8a41-4414-abf6-79fc06caa773 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:30.825400 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c9fd6a49-8a41-4414-abf6-79fc06caa773 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:30.832884 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c9fd6a49-8a41-4414-abf6-79fc06caa773 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1318 microversion: 2.1 time: 0.159147 Jun 23 20:17:30.834812 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 494/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:30 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:31.007171 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:31.007717 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:31.014884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:31.015334 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:31.016095 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:31.016568 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:31.029875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] HTTP exception thrown: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Request method failure captured: Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 HTTP/1.1 Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMkhch8XWZNJTYFewOy8x-dPyO5Cw5-Sm5ZLtRwWXtFp6UlhOEnRVywNTfpi3fnqWsK1hfd2Xr7UBEM93BI0VcLY7Rzo4tHm-V7JkbF0SV4hMB9Iz4V_RtaHHlxzmKF57pXgeaY-yoFuKd82iQjabnC7ISu9pavDbXf1jMySP5C3OXk Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:17:31.031904 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ed44d3eff7af4bd1bc339244e2bc2fae", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ed44d3eff7af4bd1bc339244e2bc2fae"}]}] Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 2c5e6ea89435497c8b1b06f42e08c82e Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:31.033924 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'fbf4d745-73cd-458d-9aa6-cef42480b9f2'} Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:31.034955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:31.036509 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:31.037868 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Returning 404 to user: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:31.037868 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e2bd00d9-fd74-4756-ac55-0beefb7a76d8 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 404 len: 111 microversion: 2.1 time: 0.030416 Jun 23 20:17:31.037868 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 520/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:31 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:31.042388 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c84e096a-11e3-43cc-a3c5-dc918497d808 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '.version_select at 0x7f90da2973a0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:31.133294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c84e096a-11e3-43cc-a3c5-dc918497d808 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-699931145" status: 202 len: 0 microversion: 2.1 time: 0.094635 Jun 23 20:17:31.133860 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 495/1015] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 23 20:17:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-699931145 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:17:31.221719 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-982de91f-eadd-4fe2-a6fb-ea42ba6b75c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:31.222212 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-982de91f-eadd-4fe2-a6fb-ea42ba6b75c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:31.228111 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-982de91f-eadd-4fe2-a6fb-ea42ba6b75c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:31.228592 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-982de91f-eadd-4fe2-a6fb-ea42ba6b75c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:31.229360 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-982de91f-eadd-4fe2-a6fb-ea42ba6b75c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:31.230318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-982de91f-eadd-4fe2-a6fb-ea42ba6b75c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:31.255488 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-982de91f-eadd-4fe2-a6fb-ea42ba6b75c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:17:31.545369 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-982de91f-eadd-4fe2-a6fb-ea42ba6b75c2 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 204 len: 0 microversion: 2.1 time: 0.326966 Jun 23 20:17:31.545739 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 521/1016] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:17:31 2022] DELETE /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:17:31.555966 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a4903e62-d057-47a3-98de-ed0924b1f942 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:31.556632 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a4903e62-d057-47a3-98de-ed0924b1f942 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:31.565997 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a4903e62-d057-47a3-98de-ed0924b1f942 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:31.566455 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a4903e62-d057-47a3-98de-ed0924b1f942 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:31.567235 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a4903e62-d057-47a3-98de-ed0924b1f942 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:31.567973 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a4903e62-d057-47a3-98de-ed0924b1f942 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:31.708172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a4903e62-d057-47a3-98de-ed0924b1f942 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:31.716582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a4903e62-d057-47a3-98de-ed0924b1f942 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1552 microversion: 2.1 time: 0.166348 Jun 23 20:17:31.717140 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 496/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:31 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:17:31.850970 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8fd12238-a5b4-4009-95a1-64280c614a30 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:31.851657 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8fd12238-a5b4-4009-95a1-64280c614a30 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:31.854735 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:31.855602 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=6 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:31.859202 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8fd12238-a5b4-4009-95a1-64280c614a30 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:31.859592 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8fd12238-a5b4-4009-95a1-64280c614a30 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:31.860372 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8fd12238-a5b4-4009-95a1-64280c614a30 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:31.860804 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8fd12238-a5b4-4009-95a1-64280c614a30 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:32.013534 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8fd12238-a5b4-4009-95a1-64280c614a30 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:32.022682 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8fd12238-a5b4-4009-95a1-64280c614a30 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1318 microversion: 2.1 time: 0.175833 Jun 23 20:17:32.033349 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 522/1018] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:31 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:32.733717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a548feee-367d-4587-b151-7caac5c9f198 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:32.734328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a548feee-367d-4587-b151-7caac5c9f198 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:32.736290 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:32.741705 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a548feee-367d-4587-b151-7caac5c9f198 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:32.742208 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a548feee-367d-4587-b151-7caac5c9f198 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:32.742922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a548feee-367d-4587-b151-7caac5c9f198 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:32.743362 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a548feee-367d-4587-b151-7caac5c9f198 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:32.870711 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a548feee-367d-4587-b151-7caac5c9f198 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:32.878819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a548feee-367d-4587-b151-7caac5c9f198 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1552 microversion: 2.1 time: 0.148936 Jun 23 20:17:32.879383 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 497/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:32 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:33.040097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-190e366b-518d-4729-a5c2-4895c18edcbf tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:33.040726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-190e366b-518d-4729-a5c2-4895c18edcbf tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:33.047807 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-190e366b-518d-4729-a5c2-4895c18edcbf tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:33.048251 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-190e366b-518d-4729-a5c2-4895c18edcbf tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:33.049040 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-190e366b-518d-4729-a5c2-4895c18edcbf tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:33.049470 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-190e366b-518d-4729-a5c2-4895c18edcbf tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:33.181655 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-190e366b-518d-4729-a5c2-4895c18edcbf tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:33.189838 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-190e366b-518d-4729-a5c2-4895c18edcbf tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1318 microversion: 2.1 time: 0.153981 Jun 23 20:17:33.190406 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 523/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:33 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:33.893322 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-d1340181-92f3-4e94-abc6-ab3756d8115e req-83894bc0-c320-43fa-88ca-85dcd33a190c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c6eafe-f596-4262-9487-4cd023a99823", "name": "network-vif-deleted", "tag": "077883ce-f410-4855-8c89-e480ffa737bf"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:33.894886 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fc55a492-952c-481d-b375-51197590b00c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:33.895691 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fc55a492-952c-481d-b375-51197590b00c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:33.902672 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc55a492-952c-481d-b375-51197590b00c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:33.903875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc55a492-952c-481d-b375-51197590b00c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:33.904722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc55a492-952c-481d-b375-51197590b00c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:33.905153 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fc55a492-952c-481d-b375-51197590b00c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:33.909330 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-d1340181-92f3-4e94-abc6-ab3756d8115e req-83894bc0-c320-43fa-88ca-85dcd33a190c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:33.912652 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-d1340181-92f3-4e94-abc6-ab3756d8115e req-83894bc0-c320-43fa-88ca-85dcd33a190c service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:33.923057 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-d1340181-92f3-4e94-abc6-ab3756d8115e req-83894bc0-c320-43fa-88ca-85dcd33a190c service nova] Creating event network-vif-deleted:077883ce-f410-4855-8c89-e480ffa737bf for instance e9c6eafe-f596-4262-9487-4cd023a99823 on hv-cinder-84727 Jun 23 20:17:33.929353 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-d1340181-92f3-4e94-abc6-ab3756d8115e req-83894bc0-c320-43fa-88ca-85dcd33a190c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039658 Jun 23 20:17:33.932027 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 498/1021] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:33.980821 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fc55a492-952c-481d-b375-51197590b00c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:33.989899 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fc55a492-952c-481d-b375-51197590b00c tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1510 microversion: 2.1 time: 0.098963 Jun 23 20:17:33.990511 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 524/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:33 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1510 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:17:34.099634 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-7771a2b7-3db1-4c18-92f9-c5f551d3faca req-d640bdb8-bdcf-4709-8b8b-13827a145210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff0a60e8-ccc9-4147-99a3-2e0e3255f91e", "name": "network-vif-plugged", "status": "completed", "tag": "b8106523-839e-4862-bb0b-0f13d8cbb6fd"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:34.109810 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-7771a2b7-3db1-4c18-92f9-c5f551d3faca req-d640bdb8-bdcf-4709-8b8b-13827a145210 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:34.110190 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-7771a2b7-3db1-4c18-92f9-c5f551d3faca req-d640bdb8-bdcf-4709-8b8b-13827a145210 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:34.121222 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-7771a2b7-3db1-4c18-92f9-c5f551d3faca req-d640bdb8-bdcf-4709-8b8b-13827a145210 service nova] Creating event network-vif-plugged:b8106523-839e-4862-bb0b-0f13d8cbb6fd for instance ff0a60e8-ccc9-4147-99a3-2e0e3255f91e on hv-cinder-84727 Jun 23 20:17:34.126706 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-7771a2b7-3db1-4c18-92f9-c5f551d3faca req-d640bdb8-bdcf-4709-8b8b-13827a145210 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031365 Jun 23 20:17:34.127284 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 499/1023] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:34.206863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-688dec23-0c18-48d7-8a00-f3c239d67522 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:34.208113 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-688dec23-0c18-48d7-8a00-f3c239d67522 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:34.215704 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-688dec23-0c18-48d7-8a00-f3c239d67522 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:34.217555 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-688dec23-0c18-48d7-8a00-f3c239d67522 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:34.217555 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-688dec23-0c18-48d7-8a00-f3c239d67522 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:34.217897 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-688dec23-0c18-48d7-8a00-f3c239d67522 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:34.306913 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:34.307960 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:34.317327 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:34.319703 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:34.320792 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:34.321456 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:34.345370 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] HTTP exception thrown: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Request method failure captured: Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 HTTP/1.1 Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMkhch8XWZNJTYFewOy8x-dPyO5Cw5-Sm5ZLtRwWXtFp6UlhOEnRVywNTfpi3fnqWsK1hfd2Xr7UBEM93BI0VcLY7Rzo4tHm-V7JkbF0SV4hMB9Iz4V_RtaHHlxzmKF57pXgeaY-yoFuKd82iQjabnC7ISu9pavDbXf1jMySP5C3OXk Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:34.347060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ed44d3eff7af4bd1bc339244e2bc2fae", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ed44d3eff7af4bd1bc339244e2bc2fae"}]}] Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 2c5e6ea89435497c8b1b06f42e08c82e Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.348656 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'fbf4d745-73cd-458d-9aa6-cef42480b9f2'} Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:34.349497 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.351722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.354475 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Returning 404 to user: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:34.354475 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-db2885b0-c69b-46af-b643-6fb698043e97 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 404 len: 111 microversion: 2.1 time: 0.046409 Jun 23 20:17:34.354475 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 500/1024] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:17:34 2022] DELETE /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 20:17:34.359507 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:34.360267 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: fbf4d745-73cd-458d-9aa6-cef42480b9f2] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:34.366585 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:34.367099 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:34.367995 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:34.368465 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:34.382347 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] HTTP exception thrown: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Request method failure captured: Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 HTTP/1.1 Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMkhch8XWZNJTYFewOy8x-dPyO5Cw5-Sm5ZLtRwWXtFp6UlhOEnRVywNTfpi3fnqWsK1hfd2Xr7UBEM93BI0VcLY7Rzo4tHm-V7JkbF0SV4hMB9Iz4V_RtaHHlxzmKF57pXgeaY-yoFuKd82iQjabnC7ISu9pavDbXf1jMySP5C3OXk Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:34.386061 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ed44d3eff7af4bd1bc339244e2bc2fae", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ed44d3eff7af4bd1bc339244e2bc2fae"}]}] Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 2c5e6ea89435497c8b1b06f42e08c82e Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.388830 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'fbf4d745-73cd-458d-9aa6-cef42480b9f2'} Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:34.389749 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. Jun 23 20:17:34.391199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:34.393278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Returning 404 to user: Instance fbf4d745-73cd-458d-9aa6-cef42480b9f2 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:34.393278 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0d84a9f0-9bad-43dd-804d-065efb7e62cd tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2" status: 404 len: 111 microversion: 2.1 time: 0.029832 Jun 23 20:17:34.393597 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-688dec23-0c18-48d7-8a00-f3c239d67522 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:34.393727 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 501/1025] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:34 2022] GET /compute/v2.1/servers/fbf4d745-73cd-458d-9aa6-cef42480b9f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 20:17:34.395714 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-688dec23-0c18-48d7-8a00-f3c239d67522 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1318 microversion: 2.1 time: 0.192780 Jun 23 20:17:34.396281 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 525/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:34 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:35.007480 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:35.008004 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:35.010456 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:35.015160 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:35.015610 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:35.016397 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:35.016895 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:35.048003 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:35.048509 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:35.048972 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lazy-loading 'fault' on Instance uuid e9c6eafe-f596-4262-9487-4cd023a99823 {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:17:35.095950 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe5380b3974516ac4e5b2fd9284348', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2028a4056254026b31f412942d1f576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:35.104041 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-02d140a8-7685-4d8c-88d3-df1e3aef6ed0 tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 200 len: 1346 microversion: 2.1 time: 0.100509 Jun 23 20:17:35.104707 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 502/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:35 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:35.413219 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-6d472a9b-f6bd-4c70-a2ad-139e17d866da tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:35.413824 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-6d472a9b-f6bd-4c70-a2ad-139e17d866da tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:35.420331 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6d472a9b-f6bd-4c70-a2ad-139e17d866da tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:35.420772 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6d472a9b-f6bd-4c70-a2ad-139e17d866da tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:35.421528 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6d472a9b-f6bd-4c70-a2ad-139e17d866da tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:35.421963 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-6d472a9b-f6bd-4c70-a2ad-139e17d866da tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:35.552375 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-6d472a9b-f6bd-4c70-a2ad-139e17d866da tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:35.559841 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-6d472a9b-f6bd-4c70-a2ad-139e17d866da tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1318 microversion: 2.1 time: 0.150539 Jun 23 20:17:35.560411 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 526/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:35 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:35.662079 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:35.662569 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:35.668486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:35.669003 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:35.669777 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:35.670238 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:35.683189 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] HTTP exception thrown: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Request method failure captured: Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 HTTP/1.1 Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMkhch8XWZNJTYFewOy8x-dPyO5Cw5-Sm5ZLtRwWXtFp6UlhOEnRVywNTfpi3fnqWsK1hfd2Xr7UBEM93BI0VcLY7Rzo4tHm-V7JkbF0SV4hMB9Iz4V_RtaHHlxzmKF57pXgeaY-yoFuKd82iQjabnC7ISu9pavDbXf1jMySP5C3OXk Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:35.684807 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ed44d3eff7af4bd1bc339244e2bc2fae", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ed44d3eff7af4bd1bc339244e2bc2fae"}]}] Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 2c5e6ea89435497c8b1b06f42e08c82e Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.686506 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '94c7d315-1803-43d6-929e-04e171f188a6'} Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:35.687401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.688904 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.690399 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Returning 404 to user: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:35.690399 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-589c4499-4c87-4446-80d7-bb5c0719f055 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "DELETE /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 404 len: 111 microversion: 2.1 time: 0.028269 Jun 23 20:17:35.690399 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 503/1029] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:17:35 2022] DELETE /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:35.694564 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:35.695170 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] [instance: 94c7d315-1803-43d6-929e-04e171f188a6] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:35.701674 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:35.702123 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:35.702875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:35.703312 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:35.717021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] HTTP exception thrown: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Request method failure captured: Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 HTTP/1.1 Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMkhch8XWZNJTYFewOy8x-dPyO5Cw5-Sm5ZLtRwWXtFp6UlhOEnRVywNTfpi3fnqWsK1hfd2Xr7UBEM93BI0VcLY7Rzo4tHm-V7JkbF0SV4hMB9Iz4V_RtaHHlxzmKF57pXgeaY-yoFuKd82iQjabnC7ISu9pavDbXf1jMySP5C3OXk Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:17:35.718658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ed44d3eff7af4bd1bc339244e2bc2fae", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ed44d3eff7af4bd1bc339244e2bc2fae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ed44d3eff7af4bd1bc339244e2bc2fae"}]}] Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: ed44d3eff7af4bd1bc339244e2bc2fae Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812672310 Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 2c5e6ea89435497c8b1b06f42e08c82e Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-AttachVolumeTestJSON-812672310-project Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.720273 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '94c7d315-1803-43d6-929e-04e171f188a6'} Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:35.721112 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. Jun 23 20:17:35.722383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:35.723478 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] Returning 404 to user: Instance 94c7d315-1803-43d6-929e-04e171f188a6 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:35.723478 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e0d84120-22f4-4994-bc1a-271aed4c6188 tempest-AttachVolumeTestJSON-812672310 tempest-AttachVolumeTestJSON-812672310-project] 10.222.0.44 "GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6" status: 404 len: 111 microversion: 2.1 time: 0.029426 Jun 23 20:17:35.723478 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 527/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:35 2022] GET /compute/v2.1/servers/94c7d315-1803-43d6-929e-04e171f188a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:36.121324 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:36.122614 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] [instance: e9c6eafe-f596-4262-9487-4cd023a99823] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:36.129768 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:36.130492 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:36.131290 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:36.131722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:36.146920 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] HTTP exception thrown: Instance e9c6eafe-f596-4262-9487-4cd023a99823 could not be found. Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Request method failure captured: Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 HTTP/1.1 Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMnKNK9fv-tq_vqj_WqpKDSA8B0GHcy_HFUMYNSAviGXJa3HZMHLXzwEy_jTxBRUh8KwxVD5HHxN50d7MMKXnf78xQOZSnJsBtCtyHDJ5mAqbmgBiYPiv_sNen3sqWa4DW7dFGxWTA7-O3gXpiWI9JWjWDVjWWHkNllfX7B-JLxFsdQ Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: a2028a4056254026b31f412942d1f576 Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-TestMinimumBasicScenario-1921927918 Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:36.148616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a2028a4056254026b31f412942d1f576", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2028a4056254026b31f412942d1f576"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a2028a4056254026b31f412942d1f576"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a2028a4056254026b31f412942d1f576"}]}] Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-TestMinimumBasicScenario-1921927918 Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: a2028a4056254026b31f412942d1f576 Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1921927918 Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-TestMinimumBasicScenario-1921927918-project Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: a9fe5380b3974516ac4e5b2fd9284348 Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-TestMinimumBasicScenario-1921927918-project Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: > Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Instance e9c6eafe-f596-4262-9487-4cd023a99823 could not be found. Jun 23 20:17:36.150131 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': 'e9c6eafe-f596-4262-9487-4cd023a99823'} Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c6eafe-f596-4262-9487-4cd023a99823 could not be found. Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:36.150906 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c6eafe-f596-4262-9487-4cd023a99823 could not be found. Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c6eafe-f596-4262-9487-4cd023a99823 could not be found. Jun 23 20:17:36.152328 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:36.154067 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Returning 404 to user: Instance e9c6eafe-f596-4262-9487-4cd023a99823 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:36.154067 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-49d978d5-d2ef-4e5e-846f-45e23bcd6f6a tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823" status: 404 len: 111 microversion: 2.1 time: 0.032858 Jun 23 20:17:36.154067 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 504/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:36 2022] GET /compute/v2.1/servers/e9c6eafe-f596-4262-9487-4cd023a99823 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:36.160008 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-358cb6dc-807d-4aeb-b449-3a1b93bfce8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] Calling method '.version_select at 0x7f90de67a670>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:36.248840 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-358cb6dc-807d-4aeb-b449-3a1b93bfce8b tempest-TestMinimumBasicScenario-1921927918 tempest-TestMinimumBasicScenario-1921927918-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-102557008" status: 202 len: 0 microversion: 2.1 time: 0.092548 Jun 23 20:17:36.249526 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 528/1032] 10.222.0.44 () {58 vars in 1268 bytes} [Thu Jun 23 20:17:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-102557008 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:17:36.577383 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fb7b9f50-bcdf-4ce4-adba-aab34da7a6b2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:36.577999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fb7b9f50-bcdf-4ce4-adba-aab34da7a6b2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:36.584420 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb7b9f50-bcdf-4ce4-adba-aab34da7a6b2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:36.587144 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb7b9f50-bcdf-4ce4-adba-aab34da7a6b2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:36.587144 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb7b9f50-bcdf-4ce4-adba-aab34da7a6b2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:36.587144 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fb7b9f50-bcdf-4ce4-adba-aab34da7a6b2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:36.722259 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fb7b9f50-bcdf-4ce4-adba-aab34da7a6b2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:17:36.729842 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fb7b9f50-bcdf-4ce4-adba-aab34da7a6b2 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1508 microversion: 2.1 time: 0.157237 Jun 23 20:17:36.730392 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 505/1033] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:17:36 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:17:36.747723 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-28f4f424-95fd-4400-8301-121b147dd28b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd305cd7-12e1-4555-b65c-c9db746a8e8f", "device": "/dev/sdb"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:36.749383 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-28f4f424-95fd-4400-8301-121b147dd28b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:36.756067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28f4f424-95fd-4400-8301-121b147dd28b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:36.756539 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28f4f424-95fd-4400-8301-121b147dd28b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:36.757284 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28f4f424-95fd-4400-8301-121b147dd28b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:36.757715 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-28f4f424-95fd-4400-8301-121b147dd28b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:37.467298 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-28f4f424-95fd-4400-8301-121b147dd28b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "POST /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720327 Jun 23 20:17:37.467298 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 529/1034] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 23 20:17:36 2022] POST /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:17:41.593632 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-29f298a0-d938-4de7-90e6-8a608ca3f082 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Action: 'create', calling method: .version_select at 0x7f90d9e07e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1041512119"}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:42.169960 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-29f298a0-d938-4de7-90e6-8a608ca3f082 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.705591 Jun 23 20:17:42.170604 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 506/1035] 10.222.0.44 () {60 vars in 1154 bytes} [Thu Jun 23 20:17:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 707 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 20:17:42.182759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1c05636d-7ecd-4818-b2f1-744fc5fd0385 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90de5924c0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:42.239198 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1c05636d-7ecd-4818-b2f1-744fc5fd0385 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4" status: 200 len: 345 microversion: 2.1 time: 0.061229 Jun 23 20:17:42.239759 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 530/1036] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:17:42 2022] GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:43.253361 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7e709cfc-0411-4188-8574-db1f01601961 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90d9e485e0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:43.303443 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7e709cfc-0411-4188-8574-db1f01601961 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4" status: 200 len: 346 microversion: 2.1 time: 0.054307 Jun 23 20:17:43.304335 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 507/1037] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:17:43 2022] GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:43.322551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8084844c-2726-41e4-85bf-bd34a151603e tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Action: 'create', calling method: .version_select at 0x7f90de65fdc0>, body: {"snapshot": {"volume_id": "591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1301697587"}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:43.797814 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8084844c-2726-41e4-85bf-bd34a151603e tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.479665 Jun 23 20:17:43.798396 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 531/1038] 10.222.0.44 () {60 vars in 1161 bytes} [Thu Jun 23 20:17:43 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:43.811233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-893e1a5d-d44e-4d93-8443-9cddb027d1f5 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90da14ae50>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:43.843242 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-893e1a5d-d44e-4d93-8443-9cddb027d1f5 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48" status: 200 len: 287 microversion: 2.1 time: 0.038220 Jun 23 20:17:43.843888 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 508/1039] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 23 20:17:43 2022] GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:43.854958 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9bf9ea17-aa0f-4894-9df3-cfc21c32cb07 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90d9df58b0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:43.891582 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9bf9ea17-aa0f-4894-9df3-cfc21c32cb07 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.040181 Jun 23 20:17:43.892142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 532/1040] 10.222.0.44 () {58 vars in 1139 bytes} [Thu Jun 23 20:17:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:17:43.902234 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-93d90759-765b-4af7-b6f0-4e4077469b55 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90d9e480d0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:43.935370 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-93d90759-765b-4af7-b6f0-4e4077469b55 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48" status: 200 len: 287 microversion: 2.1 time: 0.036992 Jun 23 20:17:43.935923 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 509/1041] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 23 20:17:43 2022] GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:44.947559 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-39322b1c-171b-4258-8670-e98a1152bfb6 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90de5925e0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:44.979444 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-39322b1c-171b-4258-8670-e98a1152bfb6 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48" status: 200 len: 287 microversion: 2.1 time: 0.036214 Jun 23 20:17:44.980052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 533/1042] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 23 20:17:44 2022] GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:45.991789 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a64708f7-7cac-4f09-837c-bc466dffddb5 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90d9e07160>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:46.021988 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a64708f7-7cac-4f09-837c-bc466dffddb5 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48" status: 200 len: 287 microversion: 2.1 time: 0.034385 Jun 23 20:17:46.022579 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 510/1043] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 23 20:17:45 2022] GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:47.033560 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:47.037475 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ff25d440-752e-47a9-bbcc-62081f3890f3 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90d9decc10>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:47.077068 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ff25d440-752e-47a9-bbcc-62081f3890f3 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48" status: 200 len: 288 microversion: 2.1 time: 0.044739 Jun 23 20:17:47.077631 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 534/1044] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 23 20:17:47 2022] GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48 => generated 288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:47.084490 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=9 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:47.085267 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:47.090428 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c529423a-d436-472b-a081-ee1793ea6876 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90d9dcd040>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:47.217811 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c529423a-d436-472b-a081-ee1793ea6876 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48" status: 202 len: 0 microversion: 2.1 time: 0.131627 Jun 23 20:17:47.218703 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 511/1045] 10.222.0.44 () {58 vars in 1253 bytes} [Thu Jun 23 20:17:47 2022] DELETE /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:17:47.225385 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-92238b3d-28d7-4074-8493-cfded1610917 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90de670dc0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:47.260761 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-92238b3d-28d7-4074-8493-cfded1610917 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48" status: 200 len: 287 microversion: 2.1 time: 0.039130 Jun 23 20:17:47.261323 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 535/1046] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 23 20:17:47 2022] GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:17:48.272980 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9a07e039-ccc4-4e8a-a944-db36144ff2ce tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90da22b4c0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:48.303175 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-9a07e039-ccc4-4e8a-a944-db36144ff2ce tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] HTTP exception thrown: Snapshot 953a26a5-3350-4123-b1bc-9b2dce30cd48 could not be found. Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9a07e039-ccc4-4e8a-a944-db36144ff2ce tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Request method failure captured: Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48 HTTP/1.1 Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMpl7NkzsKlOkiMUQ24vPh9hFpIQg4TczU9A1RDO-_Ma4AsJwri_VNhP3xbDQWg5zNpQVN_ImAAkINJ2LhXATmWI5ttVlEI5CtfFXyL-1aExghKrURgSRMxfX85dDGo3sTbTMxrIVcAuZbkmufqcOCiQqBfJTJePLNbfKPJ-jpVsfd4 Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 27e2261c5de543bfbcadba9b458cd6c0 Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:48.305423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_27e2261c5de543bfbcadba9b458cd6c0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27e2261c5de543bfbcadba9b458cd6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27e2261c5de543bfbcadba9b458cd6c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/27e2261c5de543bfbcadba9b458cd6c0"}]}] Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 27e2261c5de543bfbcadba9b458cd6c0 Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesSnapshotsTestJSON-131472581-project Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 6a3bbb5c6332445e86349e4952e0742c Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesSnapshotsTestJSON-131472581-project Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Snapshot 953a26a5-3350-4123-b1bc-9b2dce30cd48 could not be found. Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '953a26a5-3350-4123-b1bc-9b2dce30cd48'} Jun 23 20:17:48.306998 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 953a26a5-3350-4123-b1bc-9b2dce30cd48 could not be found. (HTTP 404) (Request-ID: req-5ca84310-e1b2-4756-bf3f-db689159b27a) Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:48.307851 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:17:48.309015 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 953a26a5-3350-4123-b1bc-9b2dce30cd48 could not be found. Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 20:17:48.311582 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 953a26a5-3350-4123-b1bc-9b2dce30cd48 could not be found. Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 953a26a5-3350-4123-b1bc-9b2dce30cd48 could not be found. Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9a07e039-ccc4-4e8a-a944-db36144ff2ce tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Returning 404 to user: Snapshot 953a26a5-3350-4123-b1bc-9b2dce30cd48 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:48.313294 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9a07e039-ccc4-4e8a-a944-db36144ff2ce tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48" status: 404 len: 111 microversion: 2.1 time: 0.038204 Jun 23 20:17:48.314368 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 512/1047] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 23 20:17:48 2022] GET /compute/v2.1/os-snapshots/953a26a5-3350-4123-b1bc-9b2dce30cd48 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:48.321658 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fdd332b9-07d4-4036-818c-d1a94aa44480 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90de592d30>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:48.324583 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:17:48.498756 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fdd332b9-07d4-4036-818c-d1a94aa44480 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4" status: 202 len: 0 microversion: 2.1 time: 0.183773 Jun 23 20:17:48.502240 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 536/1048] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:17:48 2022] DELETE /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:17:48.507650 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-94baad0f-4391-425a-b552-3291eb30764a tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90d9f16160>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:48.564651 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-94baad0f-4391-425a-b552-3291eb30764a tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4" status: 200 len: 345 microversion: 2.1 time: 0.060768 Jun 23 20:17:48.565214 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 513/1049] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:17:48 2022] GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:17:49.577512 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e7d58001-9769-43dd-88f1-db40fa3d50f4 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90de6703a0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:49.635021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e7d58001-9769-43dd-88f1-db40fa3d50f4 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4" status: 200 len: 345 microversion: 2.1 time: 0.062319 Jun 23 20:17:49.635584 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 537/1050] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:17:49 2022] GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:50.648415 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9b4e2e76-4a57-4f67-ba46-2c5384db4fd8 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90d9dcd1f0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:50.697780 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9b4e2e76-4a57-4f67-ba46-2c5384db4fd8 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4" status: 200 len: 345 microversion: 2.1 time: 0.054231 Jun 23 20:17:50.703543 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 514/1051] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:17:50 2022] GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:17:51.711671 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a89299e5-eb10-4239-a2a7-25540b66728e tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90d9e5fc10>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:51.746827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-a89299e5-eb10-4239-a2a7-25540b66728e tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] HTTP exception thrown: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a89299e5-eb10-4239-a2a7-25540b66728e tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Request method failure captured: Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 HTTP/1.1 Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMpl7NkzsKlOkiMUQ24vPh9hFpIQg4TczU9A1RDO-_Ma4AsJwri_VNhP3xbDQWg5zNpQVN_ImAAkINJ2LhXATmWI5ttVlEI5CtfFXyL-1aExghKrURgSRMxfX85dDGo3sTbTMxrIVcAuZbkmufqcOCiQqBfJTJePLNbfKPJ-jpVsfd4 Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 27e2261c5de543bfbcadba9b458cd6c0 Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:17:51.750896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_27e2261c5de543bfbcadba9b458cd6c0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27e2261c5de543bfbcadba9b458cd6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27e2261c5de543bfbcadba9b458cd6c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/27e2261c5de543bfbcadba9b458cd6c0"}]}] Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 27e2261c5de543bfbcadba9b458cd6c0 Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-VolumesSnapshotsTestJSON-131472581-project Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 6a3bbb5c6332445e86349e4952e0742c Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-VolumesSnapshotsTestJSON-131472581-project Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4'} Jun 23 20:17:51.758516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. (HTTP 404) (Request-ID: req-125ce5b3-f110-47fa-939d-2ec82193dfca) Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:51.759570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:17:51.761081 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 20:17:51.762610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-a89299e5-eb10-4239-a2a7-25540b66728e tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Returning 404 to user: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-a89299e5-eb10-4239-a2a7-25540b66728e tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4" status: 404 len: 109 microversion: 2.1 time: 0.045225 Jun 23 20:17:51.764276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 538/1052] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:17:51 2022] GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:51.768972 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5de38f65-626e-4622-8563-ce66a9d189ba tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90da15ae50>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:51.798388 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-5de38f65-626e-4622-8563-ce66a9d189ba tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] HTTP exception thrown: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5de38f65-626e-4622-8563-ce66a9d189ba tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Request method failure captured: Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 HTTP/1.1 Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMpl7NkzsKlOkiMUQ24vPh9hFpIQg4TczU9A1RDO-_Ma4AsJwri_VNhP3xbDQWg5zNpQVN_ImAAkINJ2LhXATmWI5ttVlEI5CtfFXyL-1aExghKrURgSRMxfX85dDGo3sTbTMxrIVcAuZbkmufqcOCiQqBfJTJePLNbfKPJ-jpVsfd4 Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 27e2261c5de543bfbcadba9b458cd6c0 Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:51.800387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_27e2261c5de543bfbcadba9b458cd6c0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27e2261c5de543bfbcadba9b458cd6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27e2261c5de543bfbcadba9b458cd6c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/27e2261c5de543bfbcadba9b458cd6c0"}]}] Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 27e2261c5de543bfbcadba9b458cd6c0 Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesSnapshotsTestJSON-131472581-project Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 6a3bbb5c6332445e86349e4952e0742c Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesSnapshotsTestJSON-131472581-project Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4'} Jun 23 20:17:51.802268 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. (HTTP 404) (Request-ID: req-46b292f1-8d5f-4103-86c6-39781410731f) Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:51.803304 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 20:17:51.806230 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 20:17:51.815470 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5de38f65-626e-4622-8563-ce66a9d189ba tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Returning 404 to user: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5de38f65-626e-4622-8563-ce66a9d189ba tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4" status: 404 len: 109 microversion: 2.1 time: 0.042390 Jun 23 20:17:51.816813 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 515/1053] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:17:51 2022] DELETE /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:51.817808 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ecc7a603-1114-4812-a28d-212b1bc36e46 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Calling method '.version_select at 0x7f90de592b80>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:51.838042 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-ecc7a603-1114-4812-a28d-212b1bc36e46 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] HTTP exception thrown: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ecc7a603-1114-4812-a28d-212b1bc36e46 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Request method failure captured: Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 HTTP/1.1 Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMpl7NkzsKlOkiMUQ24vPh9hFpIQg4TczU9A1RDO-_Ma4AsJwri_VNhP3xbDQWg5zNpQVN_ImAAkINJ2LhXATmWI5ttVlEI5CtfFXyL-1aExghKrURgSRMxfX85dDGo3sTbTMxrIVcAuZbkmufqcOCiQqBfJTJePLNbfKPJ-jpVsfd4 Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 27e2261c5de543bfbcadba9b458cd6c0 Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:17:51.839978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_27e2261c5de543bfbcadba9b458cd6c0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27e2261c5de543bfbcadba9b458cd6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/27e2261c5de543bfbcadba9b458cd6c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/27e2261c5de543bfbcadba9b458cd6c0"}]}] Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 27e2261c5de543bfbcadba9b458cd6c0 Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-131472581 Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-VolumesSnapshotsTestJSON-131472581-project Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 6a3bbb5c6332445e86349e4952e0742c Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-VolumesSnapshotsTestJSON-131472581-project Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': '591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4'} Jun 23 20:17:51.842048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. (HTTP 404) (Request-ID: req-4efb39e7-d890-4c00-b099-d100ef334c3d) Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:51.842901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:17:51.844100 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 20:17:51.845307 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ecc7a603-1114-4812-a28d-212b1bc36e46 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] Returning 404 to user: Volume 591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ecc7a603-1114-4812-a28d-212b1bc36e46 tempest-VolumesSnapshotsTestJSON-131472581 tempest-VolumesSnapshotsTestJSON-131472581-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4" status: 404 len: 109 microversion: 2.1 time: 0.034645 Jun 23 20:17:51.846529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 539/1054] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:17:51 2022] GET /compute/v2.1/os-volumes/591f6dc0-1eb1-4a8e-abe1-72cda35cd7b4 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:54.382058 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bee2ba63-f0fb-4f44-b3df-a115920eb6ff tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Action: 'create', calling method: .version_select at 0x7f90da22b4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1349944305", "metadata": {"Type": "work"}}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bee2ba63-f0fb-4f44-b3df-a115920eb6ff tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Request method failure captured: Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 122 Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMpyaktXwaALbQL3VAuQfzKzvQ3DoyVn7Xwd0oXcX8WA1ty0jux1S1Bx8C8Nru4jHkJSRiJOYlBrjOjKNKKjtYb4oH52uBXw6Vz7qUvjaosC58Ml84Td0sDZ2nrScVAzWZMAdAPc4UlkgDNdSNy_HC27-anBk5BfPUTlyWKdtFAmIxU Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:54.405717 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7a72eea3466544deb83ea31091f733b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7a72eea3466544deb83ea31091f733b1"}]}] Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 02e2b6d9e34845d7b6521dd74a63c701 Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1349944305", "metadata": {"Type": "work"}}} Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: Jun 23 20:17:54.408879 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1349944305', 'metadata': {'Type': 'work'}}}} Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise error Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:54.409986 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 20:17:54.411566 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 20:17:54.413421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 20:17:54.413421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.413421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-bee2ba63-f0fb-4f44-b3df-a115920eb6ff tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:54.413421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-bee2ba63-f0fb-4f44-b3df-a115920eb6ff tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.194616 Jun 23 20:17:54.413421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 516/1055] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jun 23 20:17:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 20:17:54.422677 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ddd6efaa-165c-4560-9532-ec4cd0279ddb tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Action: 'create', calling method: .version_select at 0x7f90de67a4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-41964634", "metadata": {"Type": "work"}}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ddd6efaa-165c-4560-9532-ec4cd0279ddb tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Request method failure captured: Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 118 Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMpyaktXwaALbQL3VAuQfzKzvQ3DoyVn7Xwd0oXcX8WA1ty0jux1S1Bx8C8Nru4jHkJSRiJOYlBrjOjKNKKjtYb4oH52uBXw6Vz7qUvjaosC58Ml84Td0sDZ2nrScVAzWZMAdAPc4UlkgDNdSNy_HC27-anBk5BfPUTlyWKdtFAmIxU Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:17:54.426062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7a72eea3466544deb83ea31091f733b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7a72eea3466544deb83ea31091f733b1"}]}] Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 02e2b6d9e34845d7b6521dd74a63c701 Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-41964634", "metadata": {"Type": "work"}}} Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: Jun 23 20:17:54.427748 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-41964634', 'metadata': {'Type': 'work'}}}} Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise error Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi '0' Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:54.428862 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 20:17:54.430716 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 20:17:54.432185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 20:17:54.432185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.432185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-ddd6efaa-165c-4560-9532-ec4cd0279ddb tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:54.432185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-ddd6efaa-165c-4560-9532-ec4cd0279ddb tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013178 Jun 23 20:17:54.432185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 540/1056] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jun 23 20:17:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 23 20:17:54.445229 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4516dc36-8ec2-47b4-a67a-fe3d2fc3f396 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Action: 'create', calling method: .version_select at 0x7f90d9f615e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-870197806", "metadata": {"Type": "work"}}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4516dc36-8ec2-47b4-a67a-fe3d2fc3f396 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Request method failure captured: Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 118 Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMpyaktXwaALbQL3VAuQfzKzvQ3DoyVn7Xwd0oXcX8WA1ty0jux1S1Bx8C8Nru4jHkJSRiJOYlBrjOjKNKKjtYb4oH52uBXw6Vz7qUvjaosC58Ml84Td0sDZ2nrScVAzWZMAdAPc4UlkgDNdSNy_HC27-anBk5BfPUTlyWKdtFAmIxU Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:54.447745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7a72eea3466544deb83ea31091f733b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7a72eea3466544deb83ea31091f733b1"}]}] Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 02e2b6d9e34845d7b6521dd74a63c701 Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-870197806", "metadata": {"Type": "work"}}} Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: Jun 23 20:17:54.449424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-870197806', 'metadata': {'Type': 'work'}}}} Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise error Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi '' Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:54.450401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 20:17:54.452674 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 20:17:54.454024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 20:17:54.454024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.454024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4516dc36-8ec2-47b4-a67a-fe3d2fc3f396 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:54.454024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4516dc36-8ec2-47b4-a67a-fe3d2fc3f396 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008049 Jun 23 20:17:54.454024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 517/1057] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jun 23 20:17:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 20:17:54.461785 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-249307ab-dea2-473b-b3dd-e10c28d7abb1 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Calling method '.version_select at 0x7f90de65f0d0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-249307ab-dea2-473b-b3dd-e10c28d7abb1 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] HTTP exception thrown: Volume tempest-invalid-930389489 could not be found. Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-249307ab-dea2-473b-b3dd-e10c28d7abb1 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Request method failure captured: Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-930389489 HTTP/1.1 Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMpyaktXwaALbQL3VAuQfzKzvQ3DoyVn7Xwd0oXcX8WA1ty0jux1S1Bx8C8Nru4jHkJSRiJOYlBrjOjKNKKjtYb4oH52uBXw6Vz7qUvjaosC58Ml84Td0sDZ2nrScVAzWZMAdAPc4UlkgDNdSNy_HC27-anBk5BfPUTlyWKdtFAmIxU Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:17:54.494437 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7a72eea3466544deb83ea31091f733b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7a72eea3466544deb83ea31091f733b1"}]}] Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 02e2b6d9e34845d7b6521dd74a63c701 Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Volume tempest-invalid-930389489 could not be found. Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'tempest-invalid-930389489'} Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:54.501010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-930389489 could not be found. (HTTP 404) (Request-ID: req-598ba604-9e79-49ca-89b3-146b7aa9e343) Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.502000 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 20:17:54.503203 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-930389489 could not be found. Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:54.504359 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-930389489 could not be found. Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-930389489 could not be found. Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-249307ab-dea2-473b-b3dd-e10c28d7abb1 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Returning 404 to user: Volume tempest-invalid-930389489 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-249307ab-dea2-473b-b3dd-e10c28d7abb1 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-930389489" status: 404 len: 98 microversion: 2.1 time: 0.037078 Jun 23 20:17:54.505799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 541/1058] 10.222.0.44 () {58 vars in 1214 bytes} [Thu Jun 23 20:17:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-930389489 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 23 20:17:54.507608 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a688e0c0-f899-4907-852c-77ab75a1547e tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006060 Jun 23 20:17:54.508133 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 518/1059] 10.222.0.44 () {58 vars in 1139 bytes} [Thu Jun 23 20:17:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 20:17:54.518590 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-268ba3a1-f00c-40a3-a2dd-f2df3d0e38f3 tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005120 Jun 23 20:17:54.519200 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 542/1060] 10.222.0.44 () {58 vars in 1136 bytes} [Thu Jun 23 20:17:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 20:17:54.528427 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-89d346ca-d485-4eb4-951b-6cd13cdda26f tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Calling method '.version_select at 0x7f90de69aa60>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:54.565196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.wsgi [None req-89d346ca-d485-4eb4-951b-6cd13cdda26f tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] HTTP exception thrown: Volume 4a0ee78b-8338-4f53-83a7-0b815d26baac could not be found. Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-89d346ca-d485-4eb4-951b-6cd13cdda26f tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Request method failure captured: Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: request: DELETE /compute/v2.1/os-volumes/4a0ee78b-8338-4f53-83a7-0b815d26baac HTTP/1.1 Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept: application/json Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Accept-Encoding: identity Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Connection: close Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Length: 0 Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Content-Type: application/json Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Host: 10.222.0.44 Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Openstack-System-Scope: None Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Auth-Token: gAAAAABitMpyaktXwaALbQL3VAuQfzKzvQ3DoyVn7Xwd0oXcX8WA1ty0jux1S1Bx8C8Nru4jHkJSRiJOYlBrjOjKNKKjtYb4oH52uBXw6Vz7qUvjaosC58Ml84Td0sDZ2nrScVAzWZMAdAPc4UlkgDNdSNy_HC27-anBk5BfPUTlyWKdtFAmIxU Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Id: None Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Domain-Name: None Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Identity-Status: Confirmed Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Is-Admin-Project: True Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Id: default Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Domain-Name: Default Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Project-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Role: reader,member Jun 23 20:17:54.567165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Roles: reader,member Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7a72eea3466544deb83ea31091f733b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7a72eea3466544deb83ea31091f733b1"}]}] Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-Tenant-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Id: default Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Domain-Name: Default Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Id: 02e2b6d9e34845d7b6521dd74a63c701 Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: X-User-Name: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: method: Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: exception: Volume 4a0ee78b-8338-4f53-83a7-0b815d26baac could not be found. Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: action_args: {'id': '4a0ee78b-8338-4f53-83a7-0b815d26baac'} Jun 23 20:17:54.568626 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a0ee78b-8338-4f53-83a7-0b815d26baac could not be found. (HTTP 404) (Request-ID: req-1c80ea78-5f4b-4da3-89a0-0c914fc4e74f) Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.569648 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 20:17:54.571083 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a0ee78b-8338-4f53-83a7-0b815d26baac could not be found. Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 20:17:54.572343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a0ee78b-8338-4f53-83a7-0b815d26baac could not be found. Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a0ee78b-8338-4f53-83a7-0b815d26baac could not be found. Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-89d346ca-d485-4eb4-951b-6cd13cdda26f tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Returning 404 to user: Volume 4a0ee78b-8338-4f53-83a7-0b815d26baac could not be found. {{(pid=118345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-89d346ca-d485-4eb4-951b-6cd13cdda26f tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/4a0ee78b-8338-4f53-83a7-0b815d26baac" status: 404 len: 109 microversion: 2.1 time: 0.044125 Jun 23 20:17:54.574597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 519/1061] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 23 20:17:54 2022] DELETE /compute/v2.1/os-volumes/4a0ee78b-8338-4f53-83a7-0b815d26baac => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:54.591936 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9e304387-b296-4d24-8782-ebbd3147537e tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Calling method '.version_select at 0x7f90d9dec0d0>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:54.620838 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-9e304387-b296-4d24-8782-ebbd3147537e tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] HTTP exception thrown: Volume bc262aed-d0de-4235-91d1-5d3e3f4caed8 could not be found. Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9e304387-b296-4d24-8782-ebbd3147537e tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Request method failure captured: Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/os-volumes/bc262aed-d0de-4235-91d1-5d3e3f4caed8 HTTP/1.1 Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMpyaktXwaALbQL3VAuQfzKzvQ3DoyVn7Xwd0oXcX8WA1ty0jux1S1Bx8C8Nru4jHkJSRiJOYlBrjOjKNKKjtYb4oH52uBXw6Vz7qUvjaosC58Ml84Td0sDZ2nrScVAzWZMAdAPc4UlkgDNdSNy_HC27-anBk5BfPUTlyWKdtFAmIxU Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:17:54.623024 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7a72eea3466544deb83ea31091f733b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7a72eea3466544deb83ea31091f733b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7a72eea3466544deb83ea31091f733b1"}]}] Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 7a72eea3466544deb83ea31091f733b1 Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-VolumesNegativeTest-68423315 Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 02e2b6d9e34845d7b6521dd74a63c701 Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-VolumesNegativeTest-68423315-project Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Volume bc262aed-d0de-4235-91d1-5d3e3f4caed8 could not be found. Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'bc262aed-d0de-4235-91d1-5d3e3f4caed8'} Jun 23 20:17:54.624827 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc262aed-d0de-4235-91d1-5d3e3f4caed8 could not be found. (HTTP 404) (Request-ID: req-6c882966-700f-42f5-8243-d7fcdc7b4cd9) Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.629185 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 20:17:54.630428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc262aed-d0de-4235-91d1-5d3e3f4caed8 could not be found. Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 20:17:54.631577 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc262aed-d0de-4235-91d1-5d3e3f4caed8 could not be found. Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc262aed-d0de-4235-91d1-5d3e3f4caed8 could not be found. Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9e304387-b296-4d24-8782-ebbd3147537e tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] Returning 404 to user: Volume bc262aed-d0de-4235-91d1-5d3e3f4caed8 could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9e304387-b296-4d24-8782-ebbd3147537e tempest-VolumesNegativeTest-68423315 tempest-VolumesNegativeTest-68423315-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/bc262aed-d0de-4235-91d1-5d3e3f4caed8" status: 404 len: 109 microversion: 2.1 time: 0.048850 Jun 23 20:17:54.633875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 543/1062] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 23 20:17:54 2022] GET /compute/v2.1/os-volumes/bc262aed-d0de-4235-91d1-5d3e3f4caed8 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:17:59.894786 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-083112a1-19be-42d6-aaf9-13e089783621 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:17:59.895336 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-083112a1-19be-42d6-aaf9-13e089783621 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:17:59.903518 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-083112a1-19be-42d6-aaf9-13e089783621 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:59.904592 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-083112a1-19be-42d6-aaf9-13e089783621 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:17:59.905436 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-083112a1-19be-42d6-aaf9-13e089783621 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:17:59.906048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-083112a1-19be-42d6-aaf9-13e089783621 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:00.034196 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-083112a1-19be-42d6-aaf9-13e089783621 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lazy-loading 'services' on Instance uuid ff0a60e8-ccc9-4147-99a3-2e0e3255f91e {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:18:00.213206 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-083112a1-19be-42d6-aaf9-13e089783621 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e/os-volume_attachments/bd305cd7-12e1-4555-b65c-c9db746a8e8f" status: 202 len: 0 microversion: 2.1 time: 0.323008 Jun 23 20:18:00.217881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 520/1063] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 23 20:17:59 2022] DELETE /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e/os-volume_attachments/bd305cd7-12e1-4555-b65c-c9db746a8e8f => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:18:00.241199 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-0fef7b82-e21c-413a-86c1-33b9e1e66ff0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Action: 'create', calling method: .version_select at 0x7f90de6145e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1568129267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgtQhu2Cj5+cCgC2d50j8sPGVDPCkX8S2OXdkAaPPlubNbTMQF6fmhHhTw6yCsh+SstLg65/Xo4eUooA7sbN1tseSEK3ZbEhirf47uK5DCFrKNr+2Abkc8iSFnK7tGOkw=="}} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:18:00.267342 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-0fef7b82-e21c-413a-86c1-33b9e1e66ff0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Getting quotas for project 47ee9522c6214257b59f3a350220dc0b. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:18:00.271931 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.quota [None req-0fef7b82-e21c-413a-86c1-33b9e1e66ff0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Getting quotas for user 3fa08242da514c0d9fa719830dcfc760 and project 47ee9522c6214257b59f3a350220dc0b. Resources: {'key_pairs'} {{(pid=118346) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:18:00.400968 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-0fef7b82-e21c-413a-86c1-33b9e1e66ff0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.371078 Jun 23 20:18:00.401875 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 544/1064] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 23 20:18:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:18:01.360954 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-85214cd7-6e2c-4203-b4f1-f608286cb8ce tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:01.362122 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-85214cd7-6e2c-4203-b4f1-f608286cb8ce tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:01.368568 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-85214cd7-6e2c-4203-b4f1-f608286cb8ce tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:01.369021 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-85214cd7-6e2c-4203-b4f1-f608286cb8ce tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:01.371796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-85214cd7-6e2c-4203-b4f1-f608286cb8ce tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:01.371796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-85214cd7-6e2c-4203-b4f1-f608286cb8ce tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:01.398811 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-85214cd7-6e2c-4203-b4f1-f608286cb8ce tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Going to try to terminate instance {{(pid=118345) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:18:01.722199 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-85214cd7-6e2c-4203-b4f1-f608286cb8ce tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 204 len: 0 microversion: 2.1 time: 0.365946 Jun 23 20:18:01.723351 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 521/1065] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:18:01 2022] DELETE /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:18:01.741903 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3b81ee48-f4db-4b4d-a163-8e1468ee5455 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:01.743953 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3b81ee48-f4db-4b4d-a163-8e1468ee5455 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:01.757039 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b81ee48-f4db-4b4d-a163-8e1468ee5455 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:01.758887 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b81ee48-f4db-4b4d-a163-8e1468ee5455 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:01.760520 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b81ee48-f4db-4b4d-a163-8e1468ee5455 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:01.761428 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3b81ee48-f4db-4b4d-a163-8e1468ee5455 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:01.940736 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3b81ee48-f4db-4b4d-a163-8e1468ee5455 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:01.953312 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3b81ee48-f4db-4b4d-a163-8e1468ee5455 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1514 microversion: 2.1 time: 0.219594 Jun 23 20:18:01.954062 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 545/1066] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:01 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:02.972492 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-282d063f-890d-4995-8d92-f788e0c80f88 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:02.973192 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-282d063f-890d-4995-8d92-f788e0c80f88 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:02.979935 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-282d063f-890d-4995-8d92-f788e0c80f88 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:02.980421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-282d063f-890d-4995-8d92-f788e0c80f88 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:02.981185 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-282d063f-890d-4995-8d92-f788e0c80f88 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:02.981621 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-282d063f-890d-4995-8d92-f788e0c80f88 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:03.188826 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-282d063f-890d-4995-8d92-f788e0c80f88 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:03.197363 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-282d063f-890d-4995-8d92-f788e0c80f88 tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1514 microversion: 2.1 time: 0.229600 Jun 23 20:18:03.199688 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 522/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:02 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:04.221289 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e9243b94-0278-4ef5-9b28-208f679b941b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:04.222067 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e9243b94-0278-4ef5-9b28-208f679b941b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:04.257269 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e9243b94-0278-4ef5-9b28-208f679b941b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:04.260607 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e9243b94-0278-4ef5-9b28-208f679b941b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:04.262865 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e9243b94-0278-4ef5-9b28-208f679b941b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:04.264550 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e9243b94-0278-4ef5-9b28-208f679b941b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:04.384876 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e9243b94-0278-4ef5-9b28-208f679b941b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b02048ea85d46889e86bb8d073bf456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb032b11e045fdbb42238762eada05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:04.394684 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e9243b94-0278-4ef5-9b28-208f679b941b tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 200 len: 1472 microversion: 2.1 time: 0.182078 Jun 23 20:18:04.395261 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 546/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:04 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:04.488421 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-3d08cc1b-638f-4fe0-9d7d-f0766560664b req-88663e35-8207-4ec0-914f-c8a5c07d8547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff0a60e8-ccc9-4147-99a3-2e0e3255f91e", "name": "network-vif-deleted", "tag": "b8106523-839e-4862-bb0b-0f13d8cbb6fd"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:18:04.508346 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-3d08cc1b-638f-4fe0-9d7d-f0766560664b req-88663e35-8207-4ec0-914f-c8a5c07d8547 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:04.509593 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-3d08cc1b-638f-4fe0-9d7d-f0766560664b req-88663e35-8207-4ec0-914f-c8a5c07d8547 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:04.525802 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-3d08cc1b-638f-4fe0-9d7d-f0766560664b req-88663e35-8207-4ec0-914f-c8a5c07d8547 service nova] Creating event network-vif-deleted:b8106523-839e-4862-bb0b-0f13d8cbb6fd for instance ff0a60e8-ccc9-4147-99a3-2e0e3255f91e on hv-cinder-84727 Jun 23 20:18:04.533048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-3d08cc1b-638f-4fe0-9d7d-f0766560664b req-88663e35-8207-4ec0-914f-c8a5c07d8547 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048887 Jun 23 20:18:04.533967 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 523/1069] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:18:05.414048 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:05.414801 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] [instance: ff0a60e8-ccc9-4147-99a3-2e0e3255f91e] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:05.425135 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:05.425595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:05.426362 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:05.426802 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:05.442529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] HTTP exception thrown: Instance ff0a60e8-ccc9-4147-99a3-2e0e3255f91e could not be found. Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Request method failure captured: Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e HTTP/1.1 Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMoG3USuQrHLT5jpl5BFkIUNVNVKUTDmBzMF6NPdc_nWkq4U7ECNWTCM2auL7o7x0JSMko3h4iXOpn0T9Oswqk7ZpQqUlaxeci7FFnxmI2_7j8VrWn0gs2HGcKVJsCEgjb9r9WUi61k0471HhdoMBD3b17qlG-prFuo-JEZXWb_T9UI Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: eccb032b11e045fdbb42238762eada05 Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1435306937 Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:18:05.444076 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_eccb032b11e045fdbb42238762eada05", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eccb032b11e045fdbb42238762eada05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/eccb032b11e045fdbb42238762eada05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/eccb032b11e045fdbb42238762eada05"}]}] Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-VolumesSnapshotTestJSON-1435306937 Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: eccb032b11e045fdbb42238762eada05 Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1435306937 Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-VolumesSnapshotTestJSON-1435306937-project Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 1b02048ea85d46889e86bb8d073bf456 Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-VolumesSnapshotTestJSON-1435306937-project Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance ff0a60e8-ccc9-4147-99a3-2e0e3255f91e could not be found. Jun 23 20:18:05.446244 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'ff0a60e8-ccc9-4147-99a3-2e0e3255f91e'} Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff0a60e8-ccc9-4147-99a3-2e0e3255f91e could not be found. Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:18:05.447225 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff0a60e8-ccc9-4147-99a3-2e0e3255f91e could not be found. Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff0a60e8-ccc9-4147-99a3-2e0e3255f91e could not be found. Jun 23 20:18:05.448745 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:18:05.449923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] Returning 404 to user: Instance ff0a60e8-ccc9-4147-99a3-2e0e3255f91e could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:18:05.449923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1bee03c4-0c45-4c7d-ba56-876bd023c88d tempest-VolumesSnapshotTestJSON-1435306937 tempest-VolumesSnapshotTestJSON-1435306937-project] 10.222.0.44 "GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e" status: 404 len: 111 microversion: 2.1 time: 0.035944 Jun 23 20:18:05.449923 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 547/1070] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:05 2022] GET /compute/v2.1/servers/ff0a60e8-ccc9-4147-99a3-2e0e3255f91e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:18:25.256609 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1731408025", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1568129267", "security_groups": [{"name": "tempest-secgroup-smoke-1647112194"}], "networks": [{"uuid": "3902e04c-b472-4504-b74f-f50ae3443241"}], "block_device_mapping_v2": [{"uuid": "c80e5b56-28f8-4500-97aa-b9cad2bc843f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:18:25.264869 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:18:25.265512 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:18:25.371954 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.network.neutron [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] validate_networks() for [('3902e04c-b472-4504-b74f-f50ae3443241', None, None, None, None, None)] {{(pid=118345) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 20:18:26.133108 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Flavor limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 20:18:26.133553 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Image limits 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 20:18:26.134023 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Flavor pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 20:18:26.134427 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Image pref 0:0:0 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 20:18:26.134924 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.virt.hardware [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118345) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 20:18:26.144883 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:26.145327 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:26.146121 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:26.146605 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:26.163877 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Getting quotas for project 47ee9522c6214257b59f3a350220dc0b. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 20:18:26.167820 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.quota [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Getting quotas for user 3fa08242da514c0d9fa719830dcfc760 and project 47ee9522c6214257b59f3a350220dc0b. Resources: {'instances', 'cores', 'ram'} {{(pid=118345) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 20:18:26.225718 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Going to run 1 instances... {{(pid=118345) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 20:18:26.227988 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c80e5b56-28f8-4500-97aa-b9cad2bc843f',volume_size=None,volume_type=None)] {{(pid=118345) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 20:18:26.642570 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-0ea9a97a-ed2a-419f-811c-c9b2761ef72b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.390066 Jun 23 20:18:26.643518 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 524/1071] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 23 20:18:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 20:18:26.653630 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-73d1ee51-4866-454f-8f52-7d2d6a894252 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:26.654229 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-73d1ee51-4866-454f-8f52-7d2d6a894252 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:26.658189 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=4 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:18:26.661106 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:18:26.661106 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=14 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:18:26.715341 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-73d1ee51-4866-454f-8f52-7d2d6a894252 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:26.722114 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-73d1ee51-4866-454f-8f52-7d2d6a894252 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1089 microversion: 2.1 time: 0.072318 Jun 23 20:18:26.722749 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 548/1072] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:26 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:27.739068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-41e802ce-fa45-474d-8015-45b3b159b352 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:27.740036 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-41e802ce-fa45-474d-8015-45b3b159b352 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:27.748524 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41e802ce-fa45-474d-8015-45b3b159b352 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:27.748972 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41e802ce-fa45-474d-8015-45b3b159b352 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:27.749738 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41e802ce-fa45-474d-8015-45b3b159b352 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:27.750174 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-41e802ce-fa45-474d-8015-45b3b159b352 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:27.809951 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-41e802ce-fa45-474d-8015-45b3b159b352 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:27.817428 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-41e802ce-fa45-474d-8015-45b3b159b352 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1139 microversion: 2.1 time: 0.082303 Jun 23 20:18:27.818554 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 525/1073] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:27 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:28.840229 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f0ad9d7e-c57c-42f0-abb2-b18f457afc05 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:28.841177 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f0ad9d7e-c57c-42f0-abb2-b18f457afc05 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:28.851963 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f0ad9d7e-c57c-42f0-abb2-b18f457afc05 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:28.852933 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f0ad9d7e-c57c-42f0-abb2-b18f457afc05 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:28.853712 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f0ad9d7e-c57c-42f0-abb2-b18f457afc05 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:28.855640 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f0ad9d7e-c57c-42f0-abb2-b18f457afc05 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:28.918453 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f0ad9d7e-c57c-42f0-abb2-b18f457afc05 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:28.925962 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f0ad9d7e-c57c-42f0-abb2-b18f457afc05 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1195 microversion: 2.1 time: 0.094927 Jun 23 20:18:28.926726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 549/1074] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:28 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1195 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:29.943722 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2782e8bf-0b6e-4717-aaee-63819166f2fe tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:29.944453 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-2782e8bf-0b6e-4717-aaee-63819166f2fe tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:29.951176 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2782e8bf-0b6e-4717-aaee-63819166f2fe tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:29.951877 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2782e8bf-0b6e-4717-aaee-63819166f2fe tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:29.952651 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2782e8bf-0b6e-4717-aaee-63819166f2fe tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:29.953114 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-2782e8bf-0b6e-4717-aaee-63819166f2fe tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:30.097242 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-2782e8bf-0b6e-4717-aaee-63819166f2fe tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:30.105862 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2782e8bf-0b6e-4717-aaee-63819166f2fe tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1273 microversion: 2.1 time: 0.166167 Jun 23 20:18:30.107100 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 526/1075] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:29 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:30.484318 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-8c4f2eb6-9104-4d29-8b9c-4a1f1f70f91f req-a2b2bfb9-3d06-47c2-bf02-d46dc2e1bb36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c968a1f2-efe1-4413-955e-ee0f6b9b764a", "tag": "b05b693e-57ca-429e-bfd5-b656e4d62d22"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:18:30.496543 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-8c4f2eb6-9104-4d29-8b9c-4a1f1f70f91f req-a2b2bfb9-3d06-47c2-bf02-d46dc2e1bb36 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:30.497595 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-8c4f2eb6-9104-4d29-8b9c-4a1f1f70f91f req-a2b2bfb9-3d06-47c2-bf02-d46dc2e1bb36 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:30.513315 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-8c4f2eb6-9104-4d29-8b9c-4a1f1f70f91f req-a2b2bfb9-3d06-47c2-bf02-d46dc2e1bb36 service nova] Creating event network-changed:b05b693e-57ca-429e-bfd5-b656e4d62d22 for instance c968a1f2-efe1-4413-955e-ee0f6b9b764a on hv-cinder-84727 Jun 23 20:18:30.519872 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-8c4f2eb6-9104-4d29-8b9c-4a1f1f70f91f req-a2b2bfb9-3d06-47c2-bf02-d46dc2e1bb36 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039504 Jun 23 20:18:30.520589 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 550/1076] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:18:31.128179 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5ba921e4-2b82-495b-98a2-5ac389653951 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:31.129387 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5ba921e4-2b82-495b-98a2-5ac389653951 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:31.137994 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5ba921e4-2b82-495b-98a2-5ac389653951 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:31.139996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5ba921e4-2b82-495b-98a2-5ac389653951 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:31.139996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5ba921e4-2b82-495b-98a2-5ac389653951 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:31.139996 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5ba921e4-2b82-495b-98a2-5ac389653951 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:31.354386 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5ba921e4-2b82-495b-98a2-5ac389653951 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:31.362417 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5ba921e4-2b82-495b-98a2-5ac389653951 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.239002 Jun 23 20:18:31.367233 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 527/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:31 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:32.379478 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-9ff7d8eb-731b-490c-be29-e3052bd218db tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:32.381418 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-9ff7d8eb-731b-490c-be29-e3052bd218db tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:32.388390 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9ff7d8eb-731b-490c-be29-e3052bd218db tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:32.389026 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9ff7d8eb-731b-490c-be29-e3052bd218db tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:32.390136 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9ff7d8eb-731b-490c-be29-e3052bd218db tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:32.390743 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-9ff7d8eb-731b-490c-be29-e3052bd218db tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:32.581643 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-9ff7d8eb-731b-490c-be29-e3052bd218db tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:32.591388 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-9ff7d8eb-731b-490c-be29-e3052bd218db tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.216094 Jun 23 20:18:32.596514 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 551/1078] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:32 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:33.609147 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-1d919dbe-891e-4e6b-99a3-4131ee902d70 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:33.609712 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-1d919dbe-891e-4e6b-99a3-4131ee902d70 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:33.616211 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1d919dbe-891e-4e6b-99a3-4131ee902d70 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:33.616692 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1d919dbe-891e-4e6b-99a3-4131ee902d70 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:33.617496 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1d919dbe-891e-4e6b-99a3-4131ee902d70 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:33.617914 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-1d919dbe-891e-4e6b-99a3-4131ee902d70 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:33.752330 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-1d919dbe-891e-4e6b-99a3-4131ee902d70 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:33.760488 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-1d919dbe-891e-4e6b-99a3-4131ee902d70 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.155172 Jun 23 20:18:33.761055 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 528/1079] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:33 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:34.780863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-47ea8362-c543-495d-9c5d-01941eb44f5a tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:34.781516 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-47ea8362-c543-495d-9c5d-01941eb44f5a tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:34.788032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-47ea8362-c543-495d-9c5d-01941eb44f5a tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:34.790310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-47ea8362-c543-495d-9c5d-01941eb44f5a tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:34.790310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-47ea8362-c543-495d-9c5d-01941eb44f5a tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:34.790310 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-47ea8362-c543-495d-9c5d-01941eb44f5a tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:34.925620 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-47ea8362-c543-495d-9c5d-01941eb44f5a tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:34.933431 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-47ea8362-c543-495d-9c5d-01941eb44f5a tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.156407 Jun 23 20:18:34.933982 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 552/1080] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:34 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:35.950277 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b42775b7-6a89-40ae-9441-4a7ca5849fd3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:35.950881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b42775b7-6a89-40ae-9441-4a7ca5849fd3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:35.957422 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b42775b7-6a89-40ae-9441-4a7ca5849fd3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:35.957907 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b42775b7-6a89-40ae-9441-4a7ca5849fd3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:35.958667 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b42775b7-6a89-40ae-9441-4a7ca5849fd3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:35.959104 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b42775b7-6a89-40ae-9441-4a7ca5849fd3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:36.126564 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b42775b7-6a89-40ae-9441-4a7ca5849fd3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:36.134103 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b42775b7-6a89-40ae-9441-4a7ca5849fd3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.187622 Jun 23 20:18:36.134672 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 529/1081] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:35 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:37.151010 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-de5887b7-1d23-4aec-8b2b-1f8c5cace21e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:37.151629 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-de5887b7-1d23-4aec-8b2b-1f8c5cace21e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:37.158279 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-de5887b7-1d23-4aec-8b2b-1f8c5cace21e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:37.158724 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-de5887b7-1d23-4aec-8b2b-1f8c5cace21e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:37.159496 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-de5887b7-1d23-4aec-8b2b-1f8c5cace21e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:37.159957 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-de5887b7-1d23-4aec-8b2b-1f8c5cace21e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:37.321125 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-de5887b7-1d23-4aec-8b2b-1f8c5cace21e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:37.328657 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-de5887b7-1d23-4aec-8b2b-1f8c5cace21e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.181484 Jun 23 20:18:37.329217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 553/1082] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:37 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:38.346375 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7085face-ad87-46c5-8eda-bd1fd2375c17 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:38.347213 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7085face-ad87-46c5-8eda-bd1fd2375c17 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:38.349772 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:18:38.350445 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell0:SELECT=6 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:18:38.355279 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7085face-ad87-46c5-8eda-bd1fd2375c17 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:38.355727 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7085face-ad87-46c5-8eda-bd1fd2375c17 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:38.356521 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7085face-ad87-46c5-8eda-bd1fd2375c17 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:38.356958 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7085face-ad87-46c5-8eda-bd1fd2375c17 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:38.498162 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7085face-ad87-46c5-8eda-bd1fd2375c17 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:38.505661 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7085face-ad87-46c5-8eda-bd1fd2375c17 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.163282 Jun 23 20:18:38.509827 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 530/1083] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:38 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:39.522735 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2b898c42-12ec-4d69-b410-1adc12160fbf tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:39.523736 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2b898c42-12ec-4d69-b410-1adc12160fbf tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:39.526167 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell0:SELECT=2 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:18:39.531410 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2b898c42-12ec-4d69-b410-1adc12160fbf tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:39.531897 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2b898c42-12ec-4d69-b410-1adc12160fbf tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:39.532639 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2b898c42-12ec-4d69-b410-1adc12160fbf tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:39.533071 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2b898c42-12ec-4d69-b410-1adc12160fbf tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:39.670476 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2b898c42-12ec-4d69-b410-1adc12160fbf tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:39.678649 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2b898c42-12ec-4d69-b410-1adc12160fbf tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.159776 Jun 23 20:18:39.679214 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 554/1084] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:39 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:40.695975 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ac804695-824d-487e-ade0-b6983bcaa6da tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:40.696610 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ac804695-824d-487e-ade0-b6983bcaa6da tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:40.703068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac804695-824d-487e-ade0-b6983bcaa6da tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:40.703516 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac804695-824d-487e-ade0-b6983bcaa6da tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:40.704272 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac804695-824d-487e-ade0-b6983bcaa6da tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:40.704736 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ac804695-824d-487e-ade0-b6983bcaa6da tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:40.834157 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ac804695-824d-487e-ade0-b6983bcaa6da tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:40.842068 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ac804695-824d-487e-ade0-b6983bcaa6da tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.150511 Jun 23 20:18:40.842630 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 531/1085] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:40 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:41.355486 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-3893e666-4ff6-40a2-ad12-7ee19ca236d9 req-d056d0f9-0114-495a-a48b-4fd487a30e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c968a1f2-efe1-4413-955e-ee0f6b9b764a", "name": "network-vif-plugged", "status": "completed", "tag": "b05b693e-57ca-429e-bfd5-b656e4d62d22"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:18:41.364037 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3893e666-4ff6-40a2-ad12-7ee19ca236d9 req-d056d0f9-0114-495a-a48b-4fd487a30e20 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:41.364551 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-3893e666-4ff6-40a2-ad12-7ee19ca236d9 req-d056d0f9-0114-495a-a48b-4fd487a30e20 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:41.375319 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-3893e666-4ff6-40a2-ad12-7ee19ca236d9 req-d056d0f9-0114-495a-a48b-4fd487a30e20 service nova] Creating event network-vif-plugged:b05b693e-57ca-429e-bfd5-b656e4d62d22 for instance c968a1f2-efe1-4413-955e-ee0f6b9b764a on hv-cinder-84727 Jun 23 20:18:41.380739 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-3893e666-4ff6-40a2-ad12-7ee19ca236d9 req-d056d0f9-0114-495a-a48b-4fd487a30e20 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146531 Jun 23 20:18:41.381328 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 555/1086] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:18:41.857824 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6847e9b2-5738-4477-a2cb-4d72a5ef1805 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:41.858422 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6847e9b2-5738-4477-a2cb-4d72a5ef1805 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:41.865465 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6847e9b2-5738-4477-a2cb-4d72a5ef1805 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:41.865905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6847e9b2-5738-4477-a2cb-4d72a5ef1805 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:41.866653 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6847e9b2-5738-4477-a2cb-4d72a5ef1805 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:41.867089 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6847e9b2-5738-4477-a2cb-4d72a5ef1805 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:42.000575 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6847e9b2-5738-4477-a2cb-4d72a5ef1805 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:42.007881 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6847e9b2-5738-4477-a2cb-4d72a5ef1805 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.153938 Jun 23 20:18:42.008469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 532/1087] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:41 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:43.025349 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-593e8c94-fd40-4c85-a36a-78d1bc4a4d88 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:43.026050 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-593e8c94-fd40-4c85-a36a-78d1bc4a4d88 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:43.032313 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-593e8c94-fd40-4c85-a36a-78d1bc4a4d88 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:43.032779 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-593e8c94-fd40-4c85-a36a-78d1bc4a4d88 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:43.033537 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-593e8c94-fd40-4c85-a36a-78d1bc4a4d88 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:43.033978 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-593e8c94-fd40-4c85-a36a-78d1bc4a4d88 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:43.173885 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-593e8c94-fd40-4c85-a36a-78d1bc4a4d88 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:43.182151 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-593e8c94-fd40-4c85-a36a-78d1bc4a4d88 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.161429 Jun 23 20:18:43.182966 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 556/1088] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:43 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:44.199527 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-4e5af2dc-de78-4a0a-8f3f-dd3c013f7744 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:44.200145 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-4e5af2dc-de78-4a0a-8f3f-dd3c013f7744 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:44.207021 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4e5af2dc-de78-4a0a-8f3f-dd3c013f7744 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:44.207469 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4e5af2dc-de78-4a0a-8f3f-dd3c013f7744 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:44.208845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4e5af2dc-de78-4a0a-8f3f-dd3c013f7744 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:44.209288 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-4e5af2dc-de78-4a0a-8f3f-dd3c013f7744 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:44.339401 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-4e5af2dc-de78-4a0a-8f3f-dd3c013f7744 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:44.346787 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-4e5af2dc-de78-4a0a-8f3f-dd3c013f7744 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1261 microversion: 2.1 time: 0.151234 Jun 23 20:18:44.347351 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 533/1089] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:44 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:45.362906 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-136b41d1-2dc3-45a1-a837-4e398cccc1e6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:45.363513 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-136b41d1-2dc3-45a1-a837-4e398cccc1e6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:45.370196 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-136b41d1-2dc3-45a1-a837-4e398cccc1e6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:45.370644 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-136b41d1-2dc3-45a1-a837-4e398cccc1e6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:45.371401 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-136b41d1-2dc3-45a1-a837-4e398cccc1e6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:45.371838 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-136b41d1-2dc3-45a1-a837-4e398cccc1e6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:45.502926 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-136b41d1-2dc3-45a1-a837-4e398cccc1e6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:45.510636 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-136b41d1-2dc3-45a1-a837-4e398cccc1e6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1445 microversion: 2.1 time: 0.151540 Jun 23 20:18:45.511160 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 557/1090] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:45 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:45.527161 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-6d0477a2-b1ad-44f3-9581-c12e45c48793 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:18:45.527745 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-6d0477a2-b1ad-44f3-9581-c12e45c48793 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:18:45.534351 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d0477a2-b1ad-44f3-9581-c12e45c48793 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:45.534748 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d0477a2-b1ad-44f3-9581-c12e45c48793 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:45.535517 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d0477a2-b1ad-44f3-9581-c12e45c48793 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:45.536010 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-6d0477a2-b1ad-44f3-9581-c12e45c48793 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:45.671255 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-6d0477a2-b1ad-44f3-9581-c12e45c48793 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:18:45.678928 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-6d0477a2-b1ad-44f3-9581-c12e45c48793 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1445 microversion: 2.1 time: 0.155753 Jun 23 20:18:45.679494 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 534/1091] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:18:45 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:18:47.757364 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-dd14dcbd-69de-4efc-b42c-f77803ff6e72 req-5f394151-a075-4a84-841f-3819b1a32fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c968a1f2-efe1-4413-955e-ee0f6b9b764a", "tag": "b05b693e-57ca-429e-bfd5-b656e4d62d22"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:18:47.765381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-dd14dcbd-69de-4efc-b42c-f77803ff6e72 req-5f394151-a075-4a84-841f-3819b1a32fb3 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:18:47.765823 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-dd14dcbd-69de-4efc-b42c-f77803ff6e72 req-5f394151-a075-4a84-841f-3819b1a32fb3 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:18:47.779914 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-dd14dcbd-69de-4efc-b42c-f77803ff6e72 req-5f394151-a075-4a84-841f-3819b1a32fb3 service nova] Creating event network-changed:b05b693e-57ca-429e-bfd5-b656e4d62d22 for instance c968a1f2-efe1-4413-955e-ee0f6b9b764a on hv-cinder-84727 Jun 23 20:18:47.784860 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-dd14dcbd-69de-4efc-b42c-f77803ff6e72 req-5f394151-a075-4a84-841f-3819b1a32fb3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094600 Jun 23 20:18:47.785850 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 558/1092] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:20:36.023124 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:20:36.031948 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Thu Jun 23 20:20:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:20:40.431903 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:20:40.432366 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Thu Jun 23 20:20:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:20:42.924227 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:20:42.925033 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=62 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:20:42.929611 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:20:42.930145 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:42.936060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:42.941471 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:42.941471 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:42.941471 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:42.961266 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lazy-loading 'flavor' on Instance uuid c968a1f2-efe1-4413-955e-ee0f6b9b764a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:20:43.211536 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [a1ac534d-e6fe-4bdb-bc51-c015d490c5fb] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 20:20:44.218542 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [a1ac534d-e6fe-4bdb-bc51-c015d490c5fb] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 47432. Jun 23 20:20:44.221624 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-9cbe061b-267d-4809-bca2-618cca97bca3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "POST /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a/action" status: 202 len: 0 microversion: 2.1 time: 1.299161 Jun 23 20:20:44.222224 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 535/1093] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:20:42 2022] POST /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a/action => generated 0 bytes in 1300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:20:44.231508 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ea42ba8-1047-4c51-94b9-d5805e5a6ce3] AMQP server on 10.222.0.44:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 23 20:20:44.234566 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=24 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:20:44.235546 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=48 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:20:44.240607 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-c2ac76e7-cd2a-46f1-a52b-08007ea7705b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:44.252711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-c2ac76e7-cd2a-46f1-a52b-08007ea7705b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:44.252711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c2ac76e7-cd2a-46f1-a52b-08007ea7705b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:44.252711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c2ac76e7-cd2a-46f1-a52b-08007ea7705b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:44.252711 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c2ac76e7-cd2a-46f1-a52b-08007ea7705b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:44.253210 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-c2ac76e7-cd2a-46f1-a52b-08007ea7705b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:44.390741 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-c2ac76e7-cd2a-46f1-a52b-08007ea7705b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:44.398224 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-c2ac76e7-cd2a-46f1-a52b-08007ea7705b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.169533 Jun 23 20:20:44.398781 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 559/1094] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:44 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:45.416513 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-f5fc292f-b9d7-4ec2-8e5f-992d1b93302d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:45.417212 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-f5fc292f-b9d7-4ec2-8e5f-992d1b93302d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:45.426492 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5fc292f-b9d7-4ec2-8e5f-992d1b93302d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:45.427437 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5fc292f-b9d7-4ec2-8e5f-992d1b93302d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:45.428219 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5fc292f-b9d7-4ec2-8e5f-992d1b93302d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:45.428679 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-f5fc292f-b9d7-4ec2-8e5f-992d1b93302d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:45.556476 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-f5fc292f-b9d7-4ec2-8e5f-992d1b93302d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:45.563950 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-f5fc292f-b9d7-4ec2-8e5f-992d1b93302d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.152093 Jun 23 20:20:45.564530 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 536/1095] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:45 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:46.581602 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-704aead4-054f-4dab-a6d0-4e44d5e6db71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:46.582206 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-704aead4-054f-4dab-a6d0-4e44d5e6db71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:46.592217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-704aead4-054f-4dab-a6d0-4e44d5e6db71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:46.592694 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-704aead4-054f-4dab-a6d0-4e44d5e6db71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:46.593446 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-704aead4-054f-4dab-a6d0-4e44d5e6db71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:46.593912 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-704aead4-054f-4dab-a6d0-4e44d5e6db71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:46.599106 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ea42ba8-1047-4c51-94b9-d5805e5a6ce3] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 47446. Jun 23 20:20:46.728034 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-704aead4-054f-4dab-a6d0-4e44d5e6db71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:46.735391 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-704aead4-054f-4dab-a6d0-4e44d5e6db71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.157770 Jun 23 20:20:46.735947 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 560/1096] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:46 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:47.752819 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7a87a7c3-03d1-428d-a17f-d1cb3492f72c tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:47.753460 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7a87a7c3-03d1-428d-a17f-d1cb3492f72c tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:47.760119 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7a87a7c3-03d1-428d-a17f-d1cb3492f72c tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:47.760604 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7a87a7c3-03d1-428d-a17f-d1cb3492f72c tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:47.761365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7a87a7c3-03d1-428d-a17f-d1cb3492f72c tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:47.761805 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7a87a7c3-03d1-428d-a17f-d1cb3492f72c tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:47.890689 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7a87a7c3-03d1-428d-a17f-d1cb3492f72c tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:47.898899 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7a87a7c3-03d1-428d-a17f-d1cb3492f72c tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.149934 Jun 23 20:20:47.899462 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 537/1097] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:47 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:48.917116 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-13307af8-2f41-4e26-9887-2fe1c9380d71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:48.917721 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-13307af8-2f41-4e26-9887-2fe1c9380d71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:48.924598 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13307af8-2f41-4e26-9887-2fe1c9380d71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:48.928020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13307af8-2f41-4e26-9887-2fe1c9380d71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:48.928020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13307af8-2f41-4e26-9887-2fe1c9380d71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:48.928020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-13307af8-2f41-4e26-9887-2fe1c9380d71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:49.058948 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-13307af8-2f41-4e26-9887-2fe1c9380d71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:49.066503 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-13307af8-2f41-4e26-9887-2fe1c9380d71 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.153313 Jun 23 20:20:49.067057 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 561/1098] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:48 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:50.085933 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-712f11de-5aeb-4d51-a30e-157e5a87cd27 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:50.086519 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-712f11de-5aeb-4d51-a30e-157e5a87cd27 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:50.093217 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-712f11de-5aeb-4d51-a30e-157e5a87cd27 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:50.093671 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-712f11de-5aeb-4d51-a30e-157e5a87cd27 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:50.094423 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-712f11de-5aeb-4d51-a30e-157e5a87cd27 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:50.094866 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-712f11de-5aeb-4d51-a30e-157e5a87cd27 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:50.221313 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-712f11de-5aeb-4d51-a30e-157e5a87cd27 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:50.228779 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-712f11de-5aeb-4d51-a30e-157e5a87cd27 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.148414 Jun 23 20:20:50.229339 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 538/1099] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:50 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:51.246223 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1695632f-bb65-4e12-ad51-92ba5e47591e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:51.246825 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1695632f-bb65-4e12-ad51-92ba5e47591e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:51.253285 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1695632f-bb65-4e12-ad51-92ba5e47591e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:51.253729 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1695632f-bb65-4e12-ad51-92ba5e47591e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:51.254500 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1695632f-bb65-4e12-ad51-92ba5e47591e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:51.255586 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1695632f-bb65-4e12-ad51-92ba5e47591e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:51.382580 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-1695632f-bb65-4e12-ad51-92ba5e47591e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:51.389952 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1695632f-bb65-4e12-ad51-92ba5e47591e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.147580 Jun 23 20:20:51.390507 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 562/1100] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:51 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:52.407365 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-b0e584d5-1fcc-43a7-bdf7-1b5ee81698fa tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:52.408000 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-b0e584d5-1fcc-43a7-bdf7-1b5ee81698fa tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:52.414545 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b0e584d5-1fcc-43a7-bdf7-1b5ee81698fa tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:52.414990 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b0e584d5-1fcc-43a7-bdf7-1b5ee81698fa tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:52.415746 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b0e584d5-1fcc-43a7-bdf7-1b5ee81698fa tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:52.416181 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-b0e584d5-1fcc-43a7-bdf7-1b5ee81698fa tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:52.546907 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-b0e584d5-1fcc-43a7-bdf7-1b5ee81698fa tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:52.555024 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-b0e584d5-1fcc-43a7-bdf7-1b5ee81698fa tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.151524 Jun 23 20:20:52.555574 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 539/1101] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:52 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:53.572651 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-5aec1c37-1806-4c44-b8a0-eb609b03b885 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:53.573261 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-5aec1c37-1806-4c44-b8a0-eb609b03b885 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:53.579739 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5aec1c37-1806-4c44-b8a0-eb609b03b885 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:53.580188 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5aec1c37-1806-4c44-b8a0-eb609b03b885 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:53.580984 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5aec1c37-1806-4c44-b8a0-eb609b03b885 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:53.581423 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-5aec1c37-1806-4c44-b8a0-eb609b03b885 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:53.709021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-5aec1c37-1806-4c44-b8a0-eb609b03b885 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:53.716692 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-5aec1c37-1806-4c44-b8a0-eb609b03b885 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.147995 Jun 23 20:20:53.717247 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 563/1102] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:53 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:54.734178 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5824fff2-6b14-4147-9005-b02ad3589de6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:54.734773 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5824fff2-6b14-4147-9005-b02ad3589de6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:54.742018 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5824fff2-6b14-4147-9005-b02ad3589de6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:54.742500 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5824fff2-6b14-4147-9005-b02ad3589de6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:54.743266 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5824fff2-6b14-4147-9005-b02ad3589de6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:54.743708 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5824fff2-6b14-4147-9005-b02ad3589de6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:54.877072 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-5824fff2-6b14-4147-9005-b02ad3589de6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:54.884790 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5824fff2-6b14-4147-9005-b02ad3589de6 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.154397 Jun 23 20:20:54.885358 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 540/1103] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:54 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:55.902348 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-45539ac5-ad9a-4ed8-8dca-02b03ee90db8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:55.902930 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-45539ac5-ad9a-4ed8-8dca-02b03ee90db8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:55.909619 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45539ac5-ad9a-4ed8-8dca-02b03ee90db8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:55.910136 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45539ac5-ad9a-4ed8-8dca-02b03ee90db8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:55.910901 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45539ac5-ad9a-4ed8-8dca-02b03ee90db8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:55.911345 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-45539ac5-ad9a-4ed8-8dca-02b03ee90db8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:56.046828 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-45539ac5-ad9a-4ed8-8dca-02b03ee90db8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:56.054884 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-45539ac5-ad9a-4ed8-8dca-02b03ee90db8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.156421 Jun 23 20:20:56.055440 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 564/1104] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:55 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:57.070886 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-ab8c2a94-50e6-44b0-814a-d1bb8eed7b3d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:57.071491 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-ab8c2a94-50e6-44b0-814a-d1bb8eed7b3d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:57.078605 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ab8c2a94-50e6-44b0-814a-d1bb8eed7b3d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:57.079048 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ab8c2a94-50e6-44b0-814a-d1bb8eed7b3d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:57.079796 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ab8c2a94-50e6-44b0-814a-d1bb8eed7b3d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:57.080223 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-ab8c2a94-50e6-44b0-814a-d1bb8eed7b3d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:57.215320 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-ab8c2a94-50e6-44b0-814a-d1bb8eed7b3d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:57.223241 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-ab8c2a94-50e6-44b0-814a-d1bb8eed7b3d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.156154 Jun 23 20:20:57.223882 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 541/1105] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:57 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:58.240955 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f7d77e8e-ccaf-4a93-843d-78625fcff52e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:58.241557 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f7d77e8e-ccaf-4a93-843d-78625fcff52e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:58.247973 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f7d77e8e-ccaf-4a93-843d-78625fcff52e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:58.248456 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f7d77e8e-ccaf-4a93-843d-78625fcff52e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:58.249214 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f7d77e8e-ccaf-4a93-843d-78625fcff52e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:58.249643 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f7d77e8e-ccaf-4a93-843d-78625fcff52e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:58.383036 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f7d77e8e-ccaf-4a93-843d-78625fcff52e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:58.390650 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f7d77e8e-ccaf-4a93-843d-78625fcff52e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1571 microversion: 2.1 time: 0.154232 Jun 23 20:20:58.391204 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 565/1106] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:58 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:58.407690 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-5cb8dd69-937c-4ecf-9778-f588e7b60073 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:20:58.408252 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-5cb8dd69-937c-4ecf-9778-f588e7b60073 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:58.416432 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cb8dd69-937c-4ecf-9778-f588e7b60073 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:58.418922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cb8dd69-937c-4ecf-9778-f588e7b60073 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:58.418922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cb8dd69-937c-4ecf-9778-f588e7b60073 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:58.418922 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-5cb8dd69-937c-4ecf-9778-f588e7b60073 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:58.703616 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-5cb8dd69-937c-4ecf-9778-f588e7b60073 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "POST /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a/action" status: 202 len: 0 microversion: 2.1 time: 0.300677 Jun 23 20:20:58.704213 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 542/1107] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 23 20:20:58 2022] POST /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:20:58.712095 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e7767d2a-02ce-4c61-883d-d1dc997f0e51 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:58.712718 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e7767d2a-02ce-4c61-883d-d1dc997f0e51 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:58.718863 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e7767d2a-02ce-4c61-883d-d1dc997f0e51 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:58.719305 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e7767d2a-02ce-4c61-883d-d1dc997f0e51 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:58.720054 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e7767d2a-02ce-4c61-883d-d1dc997f0e51 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:58.720522 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e7767d2a-02ce-4c61-883d-d1dc997f0e51 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:58.852028 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e7767d2a-02ce-4c61-883d-d1dc997f0e51 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:20:58.859451 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e7767d2a-02ce-4c61-883d-d1dc997f0e51 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1519 microversion: 2.1 time: 0.151158 Jun 23 20:20:58.860018 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 566/1108] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:58 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:20:59.877777 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-75e25fc1-3d74-4c0b-bc4f-e6760c1d2bb9 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:20:59.878384 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-75e25fc1-3d74-4c0b-bc4f-e6760c1d2bb9 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:20:59.884901 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-75e25fc1-3d74-4c0b-bc4f-e6760c1d2bb9 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:59.885343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-75e25fc1-3d74-4c0b-bc4f-e6760c1d2bb9 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:20:59.886089 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-75e25fc1-3d74-4c0b-bc4f-e6760c1d2bb9 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:20:59.886518 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-75e25fc1-3d74-4c0b-bc4f-e6760c1d2bb9 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:00.017389 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-75e25fc1-3d74-4c0b-bc4f-e6760c1d2bb9 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:00.024999 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-75e25fc1-3d74-4c0b-bc4f-e6760c1d2bb9 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1519 microversion: 2.1 time: 0.151496 Jun 23 20:21:00.025548 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 543/1109] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:20:59 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 20:21:01.042234 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-e4ce43af-9ba7-4dc3-a372-ecd2ef9d3515 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:01.042849 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-e4ce43af-9ba7-4dc3-a372-ecd2ef9d3515 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:01.049339 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e4ce43af-9ba7-4dc3-a372-ecd2ef9d3515 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:01.049798 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e4ce43af-9ba7-4dc3-a372-ecd2ef9d3515 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:01.050553 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e4ce43af-9ba7-4dc3-a372-ecd2ef9d3515 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:01.050992 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-e4ce43af-9ba7-4dc3-a372-ecd2ef9d3515 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:01.183732 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-e4ce43af-9ba7-4dc3-a372-ecd2ef9d3515 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:01.191601 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-e4ce43af-9ba7-4dc3-a372-ecd2ef9d3515 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1521 microversion: 2.1 time: 0.153172 Jun 23 20:21:01.192267 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 567/1110] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:01 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:01.736680 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-d90f6ceb-4a1d-4431-a1e9-5b38be947e03 req-8034e532-9c50-4e06-9a92-753a4ff2adfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c968a1f2-efe1-4413-955e-ee0f6b9b764a", "name": "network-vif-unplugged", "status": "completed", "tag": "b05b693e-57ca-429e-bfd5-b656e4d62d22"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:21:01.746354 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-d90f6ceb-4a1d-4431-a1e9-5b38be947e03 req-8034e532-9c50-4e06-9a92-753a4ff2adfd service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:01.746800 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-d90f6ceb-4a1d-4431-a1e9-5b38be947e03 req-8034e532-9c50-4e06-9a92-753a4ff2adfd service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:01.758016 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-d90f6ceb-4a1d-4431-a1e9-5b38be947e03 req-8034e532-9c50-4e06-9a92-753a4ff2adfd service nova] Creating event network-vif-unplugged:b05b693e-57ca-429e-bfd5-b656e4d62d22 for instance c968a1f2-efe1-4413-955e-ee0f6b9b764a on hv-cinder-84727 Jun 23 20:21:01.762848 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-d90f6ceb-4a1d-4431-a1e9-5b38be947e03 req-8034e532-9c50-4e06-9a92-753a4ff2adfd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029861 Jun 23 20:21:01.763425 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 544/1111] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:21:02.209473 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-3ac8e606-5317-4419-828f-0a6eb1092a7f tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:02.210142 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-3ac8e606-5317-4419-828f-0a6eb1092a7f tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:02.217283 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3ac8e606-5317-4419-828f-0a6eb1092a7f tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:02.217726 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3ac8e606-5317-4419-828f-0a6eb1092a7f tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:02.218473 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3ac8e606-5317-4419-828f-0a6eb1092a7f tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:02.218902 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-3ac8e606-5317-4419-828f-0a6eb1092a7f tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:02.361905 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-3ac8e606-5317-4419-828f-0a6eb1092a7f tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:02.370003 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-3ac8e606-5317-4419-828f-0a6eb1092a7f tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.164341 Jun 23 20:21:02.370555 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 568/1112] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:02 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:03.387486 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-7383cab9-b21d-4d53-8747-c2779f1fd690 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:03.388182 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-7383cab9-b21d-4d53-8747-c2779f1fd690 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:03.394893 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7383cab9-b21d-4d53-8747-c2779f1fd690 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:03.395343 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7383cab9-b21d-4d53-8747-c2779f1fd690 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:03.396094 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7383cab9-b21d-4d53-8747-c2779f1fd690 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:03.396551 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-7383cab9-b21d-4d53-8747-c2779f1fd690 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:03.529315 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-7383cab9-b21d-4d53-8747-c2779f1fd690 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:03.536682 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-7383cab9-b21d-4d53-8747-c2779f1fd690 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.153407 Jun 23 20:21:03.537244 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 545/1113] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:03 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:04.554951 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-8910cc3c-37b8-44f2-bd8e-f64871c57c15 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:04.555489 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-8910cc3c-37b8-44f2-bd8e-f64871c57c15 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:04.561880 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8910cc3c-37b8-44f2-bd8e-f64871c57c15 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:04.562352 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8910cc3c-37b8-44f2-bd8e-f64871c57c15 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:04.563101 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8910cc3c-37b8-44f2-bd8e-f64871c57c15 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:04.563529 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-8910cc3c-37b8-44f2-bd8e-f64871c57c15 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:04.697498 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-8910cc3c-37b8-44f2-bd8e-f64871c57c15 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:04.704948 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-8910cc3c-37b8-44f2-bd8e-f64871c57c15 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.154546 Jun 23 20:21:04.705517 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 569/1114] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:04 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:05.722218 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-a13fa82c-6d1e-42cb-9ce0-74965871b8ab tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:05.722857 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-a13fa82c-6d1e-42cb-9ce0-74965871b8ab tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:05.729543 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a13fa82c-6d1e-42cb-9ce0-74965871b8ab tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:05.729993 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a13fa82c-6d1e-42cb-9ce0-74965871b8ab tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:05.730757 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a13fa82c-6d1e-42cb-9ce0-74965871b8ab tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:05.731195 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-a13fa82c-6d1e-42cb-9ce0-74965871b8ab tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:05.860312 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-a13fa82c-6d1e-42cb-9ce0-74965871b8ab tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:05.868243 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-a13fa82c-6d1e-42cb-9ce0-74965871b8ab tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.149922 Jun 23 20:21:05.868831 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 546/1115] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:05 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:06.885810 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-f9f5a116-75ef-4bb9-9ade-d2e1d16857ee tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:06.886413 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-f9f5a116-75ef-4bb9-9ade-d2e1d16857ee tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:06.893207 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f9f5a116-75ef-4bb9-9ade-d2e1d16857ee tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:06.893661 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f9f5a116-75ef-4bb9-9ade-d2e1d16857ee tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:06.894413 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f9f5a116-75ef-4bb9-9ade-d2e1d16857ee tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:06.894850 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-f9f5a116-75ef-4bb9-9ade-d2e1d16857ee tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:07.029612 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-f9f5a116-75ef-4bb9-9ade-d2e1d16857ee tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:07.037134 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-f9f5a116-75ef-4bb9-9ade-d2e1d16857ee tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.155787 Jun 23 20:21:07.037694 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 570/1116] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:06 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:08.054586 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-12cc3a25-186b-45d6-9314-8ea60b271b10 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:08.055215 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-12cc3a25-186b-45d6-9314-8ea60b271b10 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:08.061242 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-12cc3a25-186b-45d6-9314-8ea60b271b10 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:08.061683 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-12cc3a25-186b-45d6-9314-8ea60b271b10 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:08.062424 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-12cc3a25-186b-45d6-9314-8ea60b271b10 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:08.062854 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-12cc3a25-186b-45d6-9314-8ea60b271b10 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:08.189186 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-12cc3a25-186b-45d6-9314-8ea60b271b10 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:08.196646 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-12cc3a25-186b-45d6-9314-8ea60b271b10 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.146074 Jun 23 20:21:08.197212 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 547/1117] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:08 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:09.213539 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-7cce8368-eb94-41b2-bde2-50783f54956e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:09.214097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-7cce8368-eb94-41b2-bde2-50783f54956e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:09.220829 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7cce8368-eb94-41b2-bde2-50783f54956e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:09.221276 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7cce8368-eb94-41b2-bde2-50783f54956e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:09.222032 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7cce8368-eb94-41b2-bde2-50783f54956e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:09.222465 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-7cce8368-eb94-41b2-bde2-50783f54956e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:09.357176 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-7cce8368-eb94-41b2-bde2-50783f54956e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:09.364677 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-7cce8368-eb94-41b2-bde2-50783f54956e tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.155400 Jun 23 20:21:09.365248 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 571/1118] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:09 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:10.381950 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-140de372-16ae-410e-a86f-35b65466b642 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:10.383201 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-140de372-16ae-410e-a86f-35b65466b642 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:10.389905 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-140de372-16ae-410e-a86f-35b65466b642 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:10.390392 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-140de372-16ae-410e-a86f-35b65466b642 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:10.391156 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-140de372-16ae-410e-a86f-35b65466b642 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:10.391591 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-140de372-16ae-410e-a86f-35b65466b642 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:10.521865 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-140de372-16ae-410e-a86f-35b65466b642 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:10.529707 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-140de372-16ae-410e-a86f-35b65466b642 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.151587 Jun 23 20:21:10.530275 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 548/1119] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:10 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:11.546496 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-2c7e4972-f697-454d-b80b-d84d65c3a03d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:11.547020 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-2c7e4972-f697-454d-b80b-d84d65c3a03d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:11.553604 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2c7e4972-f697-454d-b80b-d84d65c3a03d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:11.554047 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2c7e4972-f697-454d-b80b-d84d65c3a03d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:11.555148 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2c7e4972-f697-454d-b80b-d84d65c3a03d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:11.555579 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-2c7e4972-f697-454d-b80b-d84d65c3a03d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:11.686531 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-2c7e4972-f697-454d-b80b-d84d65c3a03d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:11.694023 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-2c7e4972-f697-454d-b80b-d84d65c3a03d tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.151495 Jun 23 20:21:11.694586 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 572/1120] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:11 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:12.711564 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-c1fe3de8-f209-4fb0-90cb-1a9111bfe3b5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:12.712172 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-c1fe3de8-f209-4fb0-90cb-1a9111bfe3b5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:12.718924 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1fe3de8-f209-4fb0-90cb-1a9111bfe3b5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:12.719366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1fe3de8-f209-4fb0-90cb-1a9111bfe3b5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:12.720119 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1fe3de8-f209-4fb0-90cb-1a9111bfe3b5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:12.720579 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-c1fe3de8-f209-4fb0-90cb-1a9111bfe3b5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:12.724619 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:21:12.850970 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-c1fe3de8-f209-4fb0-90cb-1a9111bfe3b5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:12.859165 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-c1fe3de8-f209-4fb0-90cb-1a9111bfe3b5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.151936 Jun 23 20:21:12.859751 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 549/1121] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:12 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:13.839021 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [req-699894dd-f2a1-4be7-96b1-b94547bae618 req-719d39c0-a04a-4edb-99f9-9f04d9bc6980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c968a1f2-efe1-4413-955e-ee0f6b9b764a", "name": "network-vif-plugged", "status": "completed", "tag": "b05b693e-57ca-429e-bfd5-b656e4d62d22"}]} {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:21:13.848132 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-699894dd-f2a1-4be7-96b1-b94547bae618 req-719d39c0-a04a-4edb-99f9-9f04d9bc6980 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:13.848610 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [req-699894dd-f2a1-4be7-96b1-b94547bae618 req-719d39c0-a04a-4edb-99f9-9f04d9bc6980 service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:13.860139 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.compute.server_external_events [req-699894dd-f2a1-4be7-96b1-b94547bae618 req-719d39c0-a04a-4edb-99f9-9f04d9bc6980 service nova] Creating event network-vif-plugged:b05b693e-57ca-429e-bfd5-b656e4d62d22 for instance c968a1f2-efe1-4413-955e-ee0f6b9b764a on hv-cinder-84727 Jun 23 20:21:13.866585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [req-699894dd-f2a1-4be7-96b1-b94547bae618 req-719d39c0-a04a-4edb-99f9-9f04d9bc6980 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030158 Jun 23 20:21:13.866585 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 573/1122] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:21:13.875780 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-01b14049-bc67-47c3-a5f1-2c94e24dd37b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:13.876466 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-01b14049-bc67-47c3-a5f1-2c94e24dd37b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:13.878750 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=33 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:21:13.883608 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01b14049-bc67-47c3-a5f1-2c94e24dd37b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:13.884060 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01b14049-bc67-47c3-a5f1-2c94e24dd37b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:13.884845 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01b14049-bc67-47c3-a5f1-2c94e24dd37b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:13.885286 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-01b14049-bc67-47c3-a5f1-2c94e24dd37b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:14.021298 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-01b14049-bc67-47c3-a5f1-2c94e24dd37b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:14.029333 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-01b14049-bc67-47c3-a5f1-2c94e24dd37b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.157832 Jun 23 20:21:14.029882 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 550/1123] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:13 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:15.047950 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-fb739f0c-a946-49d0-a2f7-eda78b045c87 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:15.048669 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-fb739f0c-a946-49d0-a2f7-eda78b045c87 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:15.050625 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=31 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:21:15.056072 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb739f0c-a946-49d0-a2f7-eda78b045c87 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:15.056549 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb739f0c-a946-49d0-a2f7-eda78b045c87 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:15.057308 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb739f0c-a946-49d0-a2f7-eda78b045c87 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:15.057740 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-fb739f0c-a946-49d0-a2f7-eda78b045c87 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:15.060248 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=87 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:21:15.195052 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-fb739f0c-a946-49d0-a2f7-eda78b045c87 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:15.202519 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-fb739f0c-a946-49d0-a2f7-eda78b045c87 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1577 microversion: 2.1 time: 0.159275 Jun 23 20:21:15.203082 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 574/1124] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:15 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:21:16.219723 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-703861b0-042b-4225-b480-4baef6e93dd8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:21:16.220380 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-703861b0-042b-4225-b480-4baef6e93dd8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:21:16.226894 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-703861b0-042b-4225-b480-4baef6e93dd8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:16.227340 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-703861b0-042b-4225-b480-4baef6e93dd8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:16.228094 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-703861b0-042b-4225-b480-4baef6e93dd8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:21:16.228597 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-703861b0-042b-4225-b480-4baef6e93dd8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:21:16.355073 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-703861b0-042b-4225-b480-4baef6e93dd8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:21:16.362492 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-703861b0-042b-4225-b480-4baef6e93dd8 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1564 microversion: 2.1 time: 0.146585 Jun 23 20:21:16.363047 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 551/1125] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:21:16 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1564 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:22:30.333609 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_api:SELECT=1 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:22:30.334570 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG dbcounter [-] [118346] Writing DB stats nova_cell1:SELECT=5 {{(pid=118346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:22:30.335907 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_api:SELECT=3 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:22:30.336938 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG dbcounter [-] [118345] Writing DB stats nova_cell1:SELECT=16 {{(pid=118345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 20:22:30.339005 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-1d18e963-f32c-4d9d-852e-1d83f6e878ec tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:22:30.339771 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1d18e963-f32c-4d9d-852e-1d83f6e878ec tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:22:30.341303 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-8e2bbd60-d226-4013-8f54-a68b9df8409a req-84a4e804-8804-49f4-bae2-69f86f79deae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c968a1f2-efe1-4413-955e-ee0f6b9b764a", "tag": "b05b693e-57ca-429e-bfd5-b656e4d62d22"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:22:30.349137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1d18e963-f32c-4d9d-852e-1d83f6e878ec tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:30.349137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1d18e963-f32c-4d9d-852e-1d83f6e878ec tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:30.349137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1d18e963-f32c-4d9d-852e-1d83f6e878ec tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:30.349137 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-1d18e963-f32c-4d9d-852e-1d83f6e878ec tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:30.349520 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8e2bbd60-d226-4013-8f54-a68b9df8409a req-84a4e804-8804-49f4-bae2-69f86f79deae service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:30.349911 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-8e2bbd60-d226-4013-8f54-a68b9df8409a req-84a4e804-8804-49f4-bae2-69f86f79deae service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:30.361880 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-8e2bbd60-d226-4013-8f54-a68b9df8409a req-84a4e804-8804-49f4-bae2-69f86f79deae service nova] Creating event network-changed:b05b693e-57ca-429e-bfd5-b656e4d62d22 for instance c968a1f2-efe1-4413-955e-ee0f6b9b764a on hv-cinder-84727 Jun 23 20:22:30.368561 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-8e2bbd60-d226-4013-8f54-a68b9df8409a req-84a4e804-8804-49f4-bae2-69f86f79deae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033542 Jun 23 20:22:30.369527 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 552/1126] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 20:22:30.376027 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-1d18e963-f32c-4d9d-852e-1d83f6e878ec tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Going to try to terminate instance {{(pid=118346) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 20:22:30.722504 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-1d18e963-f32c-4d9d-852e-1d83f6e878ec tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 204 len: 0 microversion: 2.1 time: 0.388774 Jun 23 20:22:30.731540 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-33adaadf-2e4a-4280-aaf1-91397dec18a0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:22:30.735366 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-33adaadf-2e4a-4280-aaf1-91397dec18a0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:22:30.735499 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 575/1127] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 23 20:22:30 2022] DELETE /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 20:22:30.740111 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33adaadf-2e4a-4280-aaf1-91397dec18a0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:30.740583 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33adaadf-2e4a-4280-aaf1-91397dec18a0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:30.741839 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33adaadf-2e4a-4280-aaf1-91397dec18a0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:30.741839 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-33adaadf-2e4a-4280-aaf1-91397dec18a0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:30.937705 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-33adaadf-2e4a-4280-aaf1-91397dec18a0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:22:30.946429 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-33adaadf-2e4a-4280-aaf1-91397dec18a0 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.220847 Jun 23 20:22:30.946989 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 553/1128] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:22:30 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:22:31.963573 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-75c29595-5ba0-4bee-add3-65328c81a5f5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:22:31.971896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-75c29595-5ba0-4bee-add3-65328c81a5f5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:22:31.971896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75c29595-5ba0-4bee-add3-65328c81a5f5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:31.971896 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75c29595-5ba0-4bee-add3-65328c81a5f5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:31.972484 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75c29595-5ba0-4bee-add3-65328c81a5f5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:31.972925 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-75c29595-5ba0-4bee-add3-65328c81a5f5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:32.154722 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-75c29595-5ba0-4bee-add3-65328c81a5f5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:22:32.162217 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-75c29595-5ba0-4bee-add3-65328c81a5f5 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1570 microversion: 2.1 time: 0.202995 Jun 23 20:22:32.162773 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 576/1129] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:22:31 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1570 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:22:33.014508 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [req-c0469a8c-d58f-448f-a626-ba1fdf03f84f req-bd6cb1ed-9c31-468d-8820-22d8d6e7508d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c968a1f2-efe1-4413-955e-ee0f6b9b764a", "name": "network-vif-deleted", "tag": "b05b693e-57ca-429e-bfd5-b656e4d62d22"}]} {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 20:22:33.022768 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-c0469a8c-d58f-448f-a626-ba1fdf03f84f req-bd6cb1ed-9c31-468d-8820-22d8d6e7508d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:33.023246 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [req-c0469a8c-d58f-448f-a626-ba1fdf03f84f req-bd6cb1ed-9c31-468d-8820-22d8d6e7508d service nova] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:33.033968 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.compute.server_external_events [req-c0469a8c-d58f-448f-a626-ba1fdf03f84f req-bd6cb1ed-9c31-468d-8820-22d8d6e7508d service nova] Creating event network-vif-deleted:b05b693e-57ca-429e-bfd5-b656e4d62d22 for instance c968a1f2-efe1-4413-955e-ee0f6b9b764a on hv-cinder-84727 Jun 23 20:22:33.038985 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [req-c0469a8c-d58f-448f-a626-ba1fdf03f84f req-bd6cb1ed-9c31-468d-8820-22d8d6e7508d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086669 Jun 23 20:22:33.039591 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 554/1130] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 23 20:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 20:22:33.180651 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-4a5977ab-73e7-4fc0-8b71-814fc3752bf3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:22:33.181226 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-4a5977ab-73e7-4fc0-8b71-814fc3752bf3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:22:33.188085 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4a5977ab-73e7-4fc0-8b71-814fc3752bf3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:33.188594 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4a5977ab-73e7-4fc0-8b71-814fc3752bf3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:33.189355 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4a5977ab-73e7-4fc0-8b71-814fc3752bf3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:33.189782 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-4a5977ab-73e7-4fc0-8b71-814fc3752bf3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:33.254690 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.policy [None req-4a5977ab-73e7-4fc0-8b71-814fc3752bf3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118346) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:22:33.262579 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-4a5977ab-73e7-4fc0-8b71-814fc3752bf3 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1220 microversion: 2.1 time: 0.086385 Jun 23 20:22:33.263446 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 577/1131] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:22:33 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:22:34.280258 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:22:34.281034 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.compute.api [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118345) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:22:34.287507 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:34.287950 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:34.288846 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:34.289276 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:34.319724 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:34.320164 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG oslo_concurrency.lockutils [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:34.320635 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.objects.instance [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lazy-loading 'fault' on Instance uuid c968a1f2-efe1-4413-955e-ee0f6b9b764a {{(pid=118345) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 20:22:34.364159 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.policy [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fa08242da514c0d9fa719830dcfc760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ee9522c6214257b59f3a350220dc0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118345) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 20:22:34.372602 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-fccb8ecf-2288-472b-acef-f28100d0073b tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 200 len: 1225 microversion: 2.1 time: 0.097381 Jun 23 20:22:34.373373 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 555/1132] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:22:34 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 20:22:35.390519 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '>' {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:22:35.391117 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.compute.api [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] [instance: c968a1f2-efe1-4413-955e-ee0f6b9b764a] Fetching instance by UUID {{(pid=118346) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 20:22:35.397731 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:35.398166 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:35.398913 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 20:22:35.399337 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG oslo_concurrency.lockutils [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Lock "c482a6c1-3f12-412c-9ae5-5047910964a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 20:22:35.412799 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.wsgi [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] HTTP exception thrown: Instance c968a1f2-efe1-4413-955e-ee0f6b9b764a could not be found. Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Request method failure captured: Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: request: GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a HTTP/1.1 Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept: application/json Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Accept-Encoding: identity Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Connection: close Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Length: 0 Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Content-Type: application/json Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Host: 10.222.0.44 Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Openstack-System-Scope: None Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: User-Agent: python-urllib3/1.26.9 Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Auth-Token: gAAAAABitMpxH8EVY1utHupQgPlQwqwNKlsTLE-jnV4FFXXO_3wvT4XvB6gTUokVfqG02ArtLIjC9bLqm1vu_01qanObZOTN023EjJ-2DPHh_YwYyTmYuFNSQFJU5BTd6R69dwQCmop8VsZVRozSGg8ZUzy8Z6hAke97TRtQ_XG7L2z7O6HkhL0 Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Id: None Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Domain-Name: None Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Identity-Status: Confirmed Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Is-Admin-Project: True Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Id: default Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Domain-Name: Default Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Id: 47ee9522c6214257b59f3a350220dc0b Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Project-Name: tempest-TestShelveInstance-1109189648 Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Role: reader,member Jun 23 20:22:35.414434 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Roles: reader,member Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47ee9522c6214257b59f3a350220dc0b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47ee9522c6214257b59f3a350220dc0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47ee9522c6214257b59f3a350220dc0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47ee9522c6214257b59f3a350220dc0b"}]}] Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant: tempest-TestShelveInstance-1109189648 Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Id: 47ee9522c6214257b59f3a350220dc0b Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-Tenant-Name: tempest-TestShelveInstance-1109189648 Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User: tempest-TestShelveInstance-1109189648-project Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Id: default Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Domain-Name: Default Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Id: 3fa08242da514c0d9fa719830dcfc760 Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: X-User-Name: tempest-TestShelveInstance-1109189648-project Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: method: > Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: exception: Instance c968a1f2-efe1-4413-955e-ee0f6b9b764a could not be found. Jun 23 20:22:35.416257 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: action_args: {'id': 'c968a1f2-efe1-4413-955e-ee0f6b9b764a'} Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: {{(pid=118346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c968a1f2-efe1-4413-955e-ee0f6b9b764a could not be found. Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 20:22:35.417381 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c968a1f2-efe1-4413-955e-ee0f6b9b764a could not be found. Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c968a1f2-efe1-4413-955e-ee0f6b9b764a could not be found. Jun 23 20:22:35.419097 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: ERROR nova.api.openstack.wsgi Jun 23 20:22:35.420641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: DEBUG nova.api.openstack.wsgi [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Returning 404 to user: Instance c968a1f2-efe1-4413-955e-ee0f6b9b764a could not be found. {{(pid=118346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 20:22:35.420641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO nova.api.openstack.requestlog [None req-10bad763-ed8f-4396-a004-a356e4fb84bd tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a" status: 404 len: 111 microversion: 2.1 time: 0.029687 Jun 23 20:22:35.420641 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: [pid: 118346|app: 0|req: 578/1133] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 23 20:22:35 2022] GET /compute/v2.1/servers/c968a1f2-efe1-4413-955e-ee0f6b9b764a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 20:22:35.679055 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: DEBUG nova.api.openstack.wsgi [None req-2183102b-055e-4b7f-a5da-e0e3ff494326 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] Calling method '.version_select at 0x7f90d9dcd1f0>' {{(pid=118345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 20:22:35.794351 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO nova.api.openstack.requestlog [None req-2183102b-055e-4b7f-a5da-e0e3ff494326 tempest-TestShelveInstance-1109189648 tempest-TestShelveInstance-1109189648-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1568129267" status: 202 len: 0 microversion: 2.1 time: 0.119049 Jun 23 20:22:35.794883 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: [pid: 118345|app: 0|req: 556/1134] 10.222.0.44 () {58 vars in 1253 bytes} [Thu Jun 23 20:22:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1568129267 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 20:23:50.568030 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:23:50.568558 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Thu Jun 23 20:23:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:24:00.439881 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:24:00.440497 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Thu Jun 23 20:24:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:24:01.776983 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:24:01.777502 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Thu Jun 23 20:24:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:25:36.032812 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:25:36.033477 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Thu Jun 23 20:25:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:27:10.576725 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:27:10.577728 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Thu Jun 23 20:27:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:27:20.449462 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:27:20.450082 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Thu Jun 23 20:27:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:27:21.784854 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:27:21.785352 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Thu Jun 23 20:27:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:27:33.849130 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:27:33.849665 dv-cinder-847274-2-iscsi devstack@n-api.service[118346]: Thu Jun 23 20:27:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 20:27:38.948203 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 20:27:38.948834 dv-cinder-847274-2-iscsi devstack@n-api.service[118345]: Thu Jun 23 20:27:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!